Normally, I let adult chickens be where they want to be. The only exceptions are blizzards or tornadoes coming. Then they get locked up. For chicks, I watch out for them. They can get stranded by weather and chilled by a cold hard rain. Once they've gotten used to a new coop, gotten used to rain and know how to go in on their own, then I don't worry about them and rain.