I would definitely say that the size of the rooster would not be a factor.
I had a dozen turkeys that I raised with a few guineas (1 male), but once that male guinea matured he was the boss.
He'd 'ride' the turkeys into submission by hanging from their feathers. Quite a sight to see a 40lb tom...