Chicks are not stuck with what they learn from their mother. They could learn to like you later.
But taking them away can also be fine. If you want to do that, I would completely separate them for a few days, so the mothers and babies cannot see or hear each other. That way they will get used...