Yes, clutter is valuable.
I use blocks, bricks, pallets, random logs, overturned lawn chairs, and other such odds and ends to create spaces in the run.
This.
With 5 hens and 2 boxes the only reason anyone uses the second box is that the broody is sitting in the previous favorite.
Do you have a couple fake eggs/golf balls in each box?