My guess is the rats are living under the water containers - they'd provide weather and predator protection for them.
And yes they're very attracted to anything you'd feed a chicken, so that means no food or treats out overnight. The chickens will be fine having to wait a little for breakfast.