Modded Terraria Freezing When Interacting With The Inventory Menu

So I have started a new character with a new world after adding some new mods, but after some time of playing, the inventory would start to give me small freezes.
Things that cause them: clicking or dropping any item in my inventory, hotbar, accessory and armor slot or opening/closing my inventory. The freezes last for less than a second but they happen every time I do one of those things.
It starts happening at random times but when it does start, it will continue doing this and...

Modded Terraria Freezing When Interacting With The Inventory Menu