My coop has heated bases for the waterers, and no other supplemental heat. Chickens that are feathered out and appropriate for the climate will be fine in a well ventilated and secure coop. In really cold places, like Montana, or very north, things may be different, but otherwise, let's define 'cold'. Here occasionally -20F, but not for long, all was well.
Mary
Mary