The hen will keep them as warm as they need to be. You should probably leave them be and she will do the work. Humidity doesn't come into it when there under a hen i don't think. This is just from my experience of my hens hatching chicks outside in their coop with no heat lamp in irish weather with no problems not sure what your weather is like. 
