Raccoons would be my concern. I have heard stories of them reaching through and strangling sleeping birds. I do not know if it is true though. You could put something with a finer mesh (like .5” hardware cloth) over the bottom couple of feet and the opening right under the roof?! 
