Our old house had just as many animals...much more, actually, but more woodland area for all of those animals to have other food choices. Also, we built a much taller, smaller, better fenced in garden at the old house. We had issues with animals eating/digging plants, flowers and veggies there, too, but not this bad, and it seems to get worse and worse, here, each year, too...insect issues included.
Squirrels and chipmunks are just out of control in their quantities and destruction, now.
(Don't get me wrong...I love all my critters...but that doesn't mean I don't still want to grab them and shake them, begging them to have mercy on my yard, lol...sigh.)
It's the squirrels, chipmunks, rabbits, raccoons, groundhogs, skunks, ect...depending on what part of the yard and what is being eaten or tore up. Sometimes, even certain birds.
As for cats, we have 3, but they are indoor kitties.