You're wise to be concerned about using a heat lamp. I've had chickens burn their heads, scorching their feathers by coming into contact with the hot bulb.
I live where some nights get into the teens and single digits. I had my rooster get serious frostbite on his comb last winter, so I heat...