X 2The best thing that you could do is to start hatching or get a few hens from someone else. Good luck! I am low on hens right now, but I have been able to put one aging male in with a younger male. It isn't ideal, but I am expecting hatching eggs in the mail any day!
Personally I wouldn't go under 3 females to a male for the peace and happiness of all.
If you're not too attached maybe you can find someone near you who just keeps them for pets as well that has too many hens and rehome some of your boys in exchange for hens from them so you don't have to have so many pens and far more colonies than you expected to deal with! I know how attached one can get to them if you let yourself though, just thought I'd suggest the option.
Good luck!
Jessie