That sounds like a good plan. Just see how things go-- watch for fighting among the males, and a bare back in the female. If these things become a problem, reassess the situation.
As far as keeping two roosters and one hen, well, you can try. Brahmas are pretty mellow, usually. You'd have a better shot of them getting along with a few more hens