Yep, it will be a pain until they learn where "home" is...then you can herd them toward it if they like to run from you or lead them there if they will follow. I have a set of both. The older girls enjoy their freedom so only a few will go in when I plop food down in the pen and the rest I herd in with the help of an arm-extending stick. The younger chicks mob me for food, so all I have to do is approach the pen with a bowl and they trip over themselves (and try to trip me!) to get there first. My only problem is that I have two goats who are enthusiastic about eating chicken feed, so I have to employ some distractions and timed pen entries to complicate matters a bit.

Chicken-wise, everything is a lot easier at dusk because you've got their roosting instincts working for you.