ha ha yeah, you will be fine. Sounds like you have a beautiful coop though! If I were you, I would choose the three you would keep, but keep the other two as well...maybe have homes lined up for them just in case. If animal control ever says anything to you, comply immediately...usually we give our citizens a chance before we go writing tickets (writing tickets means I have to drive up to the court house early in the morning, sit there for three hours, and hope the person I wrote a ticket to showes up, and doesn't waste my time, and as I work evenings, this is highly inconvenient...but if they don't show, it is a criminal citation that goes to warrant).
Not to say that your city wouldn't handle things differently (so don't take my advice just because I am an ACO, do your homework, and make sure), but I work for a large city, and in all honesty, we have a LOT more important things to worry about than how many chickens you have in your yard ...especially when we are talking about such small numbers as what you have