Nope. Continue on. While it's not the best scenario, plenty of stories abound re: broody hen returning to wrong nest and eggs going cold, or power outages resulting in cold eggs. I read a study some time ago about an experiment where eggs were incubated for 3 days, then removed from the bator so an other load could be set. After 3 days, all eggs were candled, all clears removed, and the remaining eggs were combined. All eggs went on to hatch in a 21 day time frame. At worst, you may loose a bit of viability in your hatch rate. Better to loose power this early than later, IMO... though opinions and study results vary on that score as well.
My broody hen was off eggs on day 1 and 2 long enough for the eggs to go cold. Aside from 2 quitters (one of which she ate) all chicks hatched right on time, with perfect health.