Please don't put a heat lamp in your coop, they are a fire hazard. Every winter there are posts from members that have had a coop fire that cost them their entire flock (plus loss of the coop).
You might like to check out the Mama Heating Pad method of providing warmth to your chicks:
Mama Heating Pad in the Brooder (Picture Heavy) - UPDATE
Best of luck to you!