You have to kill them. You put a bucket trap (look it up on YouTube.com) or you can use poison.
Fly Bait works well as a poison - red and white can. One Tablespoon of Fly Bait to 1 cup of Coke or milk. They love it. They eat it. They die. Just keep it away from your dogs, cats, and chickens.