Whether to use a heat lamp or not depends a lot on the coop and setup for the chickens, and just judging from the photos it doesn't look to me like there is the space to do that safely. It would be too risky fire-wise, no matter how safe the lamp is supposed to be, (chicken dust, dander and floating feathers are combustible) and it would far too easy for the chickens to overheat in such a small space. More chickens die from overheating than being cold.
@Samannemm has indicated plans to rehousing them in the spring, so she quite wisely already recognizes that the coop isn't optimum for her birds. We all learn, and we all learn better when we learn firsthand. I won't tell you NOT to use one, but I personally detest the things. You are there, I am not, and you know your situation and comfort zone far better than I do.
I had one or two birds with nipped combs my first year before I understood the relationship between ventilation and the importance of not buttoning things down too tightly. Humidity is most often the culprit in frostbite. Those chickens that got nipped remained sound, healthy, content, and were with me a long time, so although it looks a little odd, it's really not that dangerous to them. If it's a real concern, a little Vaseline on the combs at night can help, but even the best housed and cared for birds can get a nip of frostbite occasionally. And no matter what we do, chickens have the odd habit of dipping into the water for a drink, then shaking their heads, depositing water on themselves or a nearby flockmate.....that can freeze before it evaporates if it's cold enough. We live in Northwestern Wyoming not too far from Yellowstone Park, so believe me, it gets darn cold here, and windy!! I never used heat, never used insulation, and never lost a bird to cold. Even my Silkies thrived, and I have photos of them going out to play in the snow when it was 9 degrees outside. The only bird I'd be watching closely is the one who has lost so many feathers, but they are generally smart enough to cozy up to the better feathered ones at night.