Whatever material you use, it sounds like the actual problem is your chickens are sleeping in the box and they shouldn't be. I clean out the nest box when I clean the coop, and that's maybe 3x a year. There's never poop in the nest box other than maybe a tiny bit they track in.