If it's been fine, don't worry about it. We have both bantams and standard birds, and the big roosters, even the one who was mating our smallest bantam hen, did no harm.
Seramas would be a different case, but otherwise a careful rooster should be safe enough.
Watch and see what's happening out...