Is there somewhere you could put them outside?
A 250W heatlamp at low, angled height will provide a warm spot for them to go when needed. That way they'll spend most of their time where it is cool and they'll be able to warm-up and dry off when needed.
Jaxx, chicks only need real serious warmth (95 degrees, draft free) for about 1-2 weeks depending on climate. After that they need someplace to warm up but should spend the majority of the time at room temperature or less. It's good for their development of feathers and prevents dehydration...
Hi Brandy, welcome to Backyard Chickens.
Your chicks are fine to produce their own body heat at that age and temperature. Most breeds at that age are fine in freezing temperatures as long as they have a shelter and some bunkmates.