Welcome! It's nothing unusual. Mine used to scratch pine shavings out but left hay alone. Now they leave pine shavings alone, too. I think they think they are making their nest.
Many people put a lip across the front of the nest boxes, about a 1"x4" so you have maybe a 3" lip, which cuts...