Keeping Roosters seperate but within site?

[SilkieCanada]

Is it a mistake if I keep my roosters in my backyard seperated by mesh fence? They can see each other but not actually interact. Well not really.

Edit: I only have 5 females. 3 roosters.

 

[Pinky]

All of the roosters I have are separated by fence. They try to spar through the fence, but they can't hurt each other. I do have a few together because they were from an unexpected hidden nest.