Fertility has nothing to do with it. An incubating egg is perfect for bacteria growth. The temperature is just right and the egg itself provided tremendous nutrients for bacteria to eat. Many bacteria cultures grown in laboratories are egg-based.
What happens is that bacteria gets inside...