In that sort of setup yes, they will freeze.
However I use one in a short (~2') and wide (3") vertical PVC pipe, which I have a submersible heater hanging down into, and mine have done fine in the cold. I've kept them both inside and outside the coop without them freezing. (That being said, I...