Not saying this is what's happening in your case, but...some broody hens are just not good mamas. A friend had a broody that was slowly eating the eggs she was sitting on and they were fertilized. She won't be allowed to brood again.
Is the litter box nest completely enclosed, or is the door...