If they start sleeping in the nest boxes now, they will always see them as the best place to sleep.
I would suggest covering them if you can't remove them. We didn't install our nest boxes in the hen house until the chicks were closer to laying age.
Also, you could go into the hen house...