The main downside to letting them get soaked is that, when they return inside, the atmosphere in the coop becomes very damp as they dry off, leading to more ammonia buildup. So, if it's pouring rain, mine are locked inside unless it's stifling hot in the coop.