It's hard to understand your setup. I'll do my best with what I have.
Your roosts should be 10-12" away from the wall. That may be your issue.
I would lower those nest boxes to ground level and give roosts at 3 and 4 feet. 12" of roost space per bird.
Make sure they can't move, or your birds...
Are your nesting boxes below or above your roosts? How much roost space do you have? How high are the roosts? What is used for the roosts? How old are your chickens?