I'd be way more concerned about the female's life than the males fighting among themselves. Seeing a pullet ganged up on by hormonal cockerels isn't pretty picture.
If you're determined to keep the roosters as pets, you can set up a separate housing/bachelor pad for them. It depends on your...