With just two hens, you also run the risk of the hens going bald due to over mating. You could always make a batchlor pen for the lower roosters and give the hens saddles if you notice feather damage starting to happen.
It depends on the roos how they will fight and when they wil fight...