It depends on your coop and breed of chicken. If your coop is drafty then the breeze steals the heat from between their feathers.
Some of my coops are drafty with the winds and when it gets very cold I throw a canvas tarp over the whole thing (hutch) but leaving an air gap for ventilation and...