What do you currently have in the nest box? A quick cheap option is to fold up a used feed bag and line the nest with that, it gives a little cushion. You can put wood shavings or straw over that.
Are you supplementing calcium in their diets? Having a dish of oyster shell available is one...