Ideally the males and females should be fed separately. They don't have the same nutritional requirements when they are adults. The biggest concern is going to be the extra calcium in laying hen fed is not needed by the rooster. If the rooster is eating laying hen feed, this can lead to kidney damage, failure and, ultimately, his death. You can continue to provide the grower feed to all the chickens and provide supplemental oyster shell for the ladies, but this is not going to provide you with a high level of egg production. You can try placing a feeder that is elevated higher for the rooster's feed. He will be bigger than your hens so only he should be able to reach it. This would allow to you offer two feeds to meet the requirements of both of your birds.