Soon as they figger out that there are eggs in there they will most definately be a problem. In fact, as soon as they discover any kind of food there they will most definately become a nusence.
I would start employing tactics immediately to scare 'em off every time they show up.
CAREFULL..if you...