Constant "Solar rain"

So me and my friend were playing through a mod pack consisting of the several big mods and some small ones too, when we defeated Skeletron, it startet raining those meteors from the solar pillar from the moonlord stuff, and occasianally there's the lightning from one of the other pillars, it has been constant since then. Is there a way to fix or stop this?

Thanks in advance