I think you put them on layer too soon. Pullets that are not laying do not need the extra calcium because it damages their kidneys, and the lower protein amount in layer feed will only slow their growth when their bodies should still be developing.
My buff orpington pullet is also about 23...