That's a tough decision. We have had the same thing happen and it can go either way.
If I were you, I would try your hardest to see if the mama will help the egg to hatch. When our first broody hens was hatching chicks this winter, she was up and running around with the already-hatched babies...