Nothing in Ponyville is more horrible then when a strange creature comes into town. And since they live next to a forest full of maticores and on top of the physical gateway to Hell itself, it's probably pretty reasonable to be afraid of anything you aren't used to.