We just call them weasles and yes they eat chickens. And if there's enough to eat they'll stay and multiply! I would buy a Live Trap, bait it with something meaty eggs, leftovers, dead chicken, whatever you've got. Or skip the trap entirely and just buy a .22

