They are just doing what they know. They grew up sleeping in a pile and that feels safe to them.
Try blocking off the nests. You can put a small box inside the nest to fill it or cut a sheet of cardboard and just slip it in front of the entrances to the nests. Hard for me to say what might...