how big is your coop? the smaller their space, the warmer it will be. some people build temporary dwelings within the dwellings like with hay bales and such. or even using tarps could create a smaller area for them to heat themselves with.
i've never done this cause it only gets in the teens...