Eileen, what you do all depends on just how much you want to try and get chicks to hatch from every egg your broody incubated. The hen usually stays on the nest for a day while most of the chicks hatch. The ones who hatch first are content to stay in the nest while their siblings hatch. The hen usually stays in the nest without eating/drinking/pooping for that day. Sometimes I've seen them eating the membranes from the hatched eggs.
Once she's taken her new family for their first outing, the rest of the eggs are left to cool. I've rarely seen a hen return to the nest and have those extra eggs hatch. Some of those may be duds, but some still contain live chicks. But the Mama hen has a new focus, her hatched chicks, and she's content to leave those others.
But, if you really really want every chick to hatch, you can do what you said or what Noriko suggested -- take the eggs out to hatch in a brooder, or take the chicks out and make Mama continue to set.
My 2 broodies seem to have been successful with their hatches. I got home after sunset and saw 2 chicks peeking out from under one hen's wings, and think I heard peeping from the other hen's nest box. I did reach under the first hen & pulled out the 2 remaining eggs to see that they weren't yet pipping, don't know how many eggs are left to hatch under the second hen. I'm looking forward to seeing the new families by daylight tomorrow.