The problem with cedar is that it is very aromatic and can cause problems with a chickens fairly delicate resp. system. Cedar shavings are the big concern though, I don't know as the lumber for the nest box would be fragerant enough to cause problems in that large of a structure unless it was freshly cut.
