How much is it going up and down? If it's staying within 36.5-39 it's not likely to be a problem, just make sure you're rotating your eggs to keep them out of hold/cold spots.
If it's spiking above that range, that's a big problem, as high temperature can kill embryos quickly.
If it's dropping, that's more complicated. Losing heat for as much as an hour a day isn't necessarily a problem for developing eggs, that's what happens in nature when a broody hen gets up to eat. Even a longer drop isn't always a big deal, as long as the eggs are spending most of their incubation as the correct temperature. But if your incubator is consistently running cool, you'll affect development in some serious ways and even if the embryos aren't quitting immediately, it will affect your hatch rate in the end.