I always wash my hands after handling the chicks, it's just good hygiene practice. Chicken manure carries some risk, not high, but like all fecal matter, it's not clean either.
That said, some of my chicks like to come over to me every time I go into the brood room, some are very gregarious...