If you have enough room it's possible things could calm down when they mature. By enough room I mean the roosters (when they mature) can get totally out of sight of each other so they avoid conflict. Some people manage with less room but it's harder.
Why do you want all those males? What are your goals with them? The only reason you need a rooster is if you want fertile eggs. Everything else is personal preference. Personal preference can be a strong motivator. I suggest you keep as few males as you can and still meet our goals. That's not because you are guaranteed problems with more males, just that problems are more likely.
Right now you do not have a flock of hens and roosters, you have a mix of a rooster, a few hens, and several chicks at various levels of maturity. In many ways that describes my flock. I typically have one mature rooster, several hens, and maybe 40 chicks (cockerels and pullets) of various ages growing to butcher size. I butcher my cockerels by the time they are 6 months old, usually just keeping one if I'm replacing my mature rooster. The rest are in the freezer. Some years it gets so wild down there that I isolate most of the cockerels in a "grow-out" pen to keep then away from the rest of the hens and pullets. Most years it doesn't get that wild down there but I remain flexible and do what I feel I need to do.
Some hens will squat for practically anything in spurs, but mature hens often are more discerning. They want the father of their potential children to be worthy. Most cockerels can't pass that test, so they try to run away once the cockerels get too big to beat up. There is another aspect. The mating act is not just about sex, it's also about dominance. The one on bottom is accepting the dominance of the one on top, either willingly or by force. The boys' hormones are saying dominate, the hens are saying you are not worthy, and it gets really rough. You are probably right, those two are getting more attention because they refuse to be dominated. I'm surprised your rooster isn't breaking that up. In my flock, when cockerels start chasing hens , the hen runs to the dominant rooster who takes care of the boys.
I don't know what your goals are or how much room you have, coops or land, runs or free range. Some of the options I see are:
1. Let it go and see what happens. They may work it out without any getting hurt and eventually be pretty peaceful. It is probably going to get really rough with the possibility of injury or death. It can be hard on you to watch. It may never get peaceful. You may need more coops or other facilities to help keep them apart.
2. Create a bachelor pad. Isolate the cockerels (all or most) in a separate pen where they can't get to the girls. Bachelor pads are usually pretty peaceful with no girls to harass or fight over.
3. Get rid of all or most of the males. Keep only the ones you need for your goals. How you get rid of them is up to you. The more you get rid of the less severe your problems will probably be.
There are variations on those but I think it is the three basic options. Good luck whatever you decide.