As far as I know, you only need a certain number of hens when you have multiple roosters. If there is no competition for the hens, then, I believe only having a few hens will be okay. I have a BR rooster and 6 hens with him and everything is fine.
As far as intruding them to each other goes...