A LOT depends on the temps now where you are. I moved my chicks out to the coop @ 9 weeks with no heat lamp but we're in Houston Texas. During the recent cold snap (28 degrees) they were in the coop w/out any heat and did fine.
Also the size of the coop. Their bodies can heat a smaller area...