Do not take him out they need to work together to hatch and raise the chicks. The only reason to remove the male is if and that's a BIG IF he hurts the chicks. The hen will let him know she is done mating for now and it will take him a bit to get used to it then things will calm down.
The hen will lay an average of 8-12 eggs before she sits tightly. Meaning she stays on the nest except to eat and poop. And as you have stated it is rare but not unheard of, my hen is a great brooder and mom. I have to take the eggs out of the cage so I don't get over run with buttons! I also...