We’ve had so stupid cold nights here lately, mid-20s, and on those nights, I just make sure that they are locked in the enclosed part of the coop. Sometimes turn on a lamp, but weaned off of it for the most part. They are 6 wks and just about fully feathered.
I also have an indoor/outdoor thermometer with a remote so that I can see how hot or cold it gets inside their space. It keeps track of high & low temps in memory. It helps me feel better about my set-up to know how well they can keep themselves warm at night. Indoor Outdoor thermometer