you can turn the room light out.
the big challenge is to avoid getting them too hot. you will need to make sure they can escape the heat - that the whole brooder isn't heated the same temp. direct the heat to one corner section. if they're cold, they'll get under it. if they're hot they'll avoid it. if you see them getting as far away as possible from the light - it's too hot. i did alot of heat light dancing for the first few days/nights trying to get it figured out.
lots of babies die from too hot.
if you have a thermometer of some kind, put in the brooder to see what your temp is. shoot for 90-95 (for just hatched). decrease the heat by changing wattage, or distance each week by about five degrees. once you have your temp arranged, then adjust by chick behavior - not so much actual temperature.
good luck with your babies. hope it goes great & you have great fun. chickens are the best.
p.s. what worked well for me when i first got mine was to give them almost warm water - either sugar water or what the hatchery sends. the warm helps them recoup from the stress & the sugar or electrolytes gives them an immediate boost that helps set them up for success. as i put each one in the brooder, i dipped their beak in the tepid water then let them go.