I think you put them on layer too soon. Pullets that are not laying do not need the extra calcium because it damages their kidneys, and the lower protein amount in layer feed will only slow their growth when their bodies should still be developing.
My buff orpington pullet is also about 23 weeks old. She's not much heavier than yours either, but she doesn't really seem to be a big eater. My RIR and little dominique are both heavier than her. They haven't started laying, so all three of them are still on 18% chick starter-grower. I don't have the proper means to weigh them but I'd guess my BO is no more than 4 lbs. I've heard they can be slow growers though. How do you pullets' combs and wattles look? My girl's are very red and getting quite big now.
Overall I'd say switch yours back to grower that's around 18%, no more than 20% protein, if you feel they haven't been developing properly. In addition, cockerels/roosters should not be on layer at any point in their lives, as (obviously) they don't lay. If your chickens are living together, when the pullets start laying, switch them to all flock/flock raiser with oyster shell on the side. That way the pullets will get calcium if they need it and the roosters won't be eating the unnecessary calcium.