With what you are describing, I dont think I would close them up. Mine are outside in the run on roosts and elsewhere during the day and can go in and out of their coop at will. Mostly they are out. It has been cold here.
Warm water and warmed food in the morning might help ease your mind...