I think your observed experience depends on how your animals were conditioned.
You leave food down all night. They are used to that. If you remove it, of course they will go into primal panic thinking the food is scarce... "It has never been limited before, but now it is. Yikes!!!!"...