I'm sorry to say but to me this sounds like a recipe for disaster. The chances of this working are slim to none. The way you'll find out is likely by a major injury to one or more of the birds. Stressed hens from over breeding probably missing feathers maybe having actual damage done to them. Roosters this spring will more than likely start fighting.
If you had significantly more hens maybe it would work but I know in my case I had 1 rooster between 10 hens and he went crazy in the spring with breeding. Many hens had naked backs, cuts, etc from him. I couldn't imagine trying multiple roos with them.
If it were me I'd drop down to 1 boy and find homes for the others. If they're pretty tame they'll likely be easier to place than a jerk-wad roo.