I would have suggested that also if they were getting in through the pen. But if they are getting in though ventilation holes in the coop itself, a bit of screen like they have on window screens could be used to cover that entrance, plus still allow the air to flow through.