Have you ever seen a rooster challenge? There's a lot of dancing and some head swinging and a bit of contact, but they all end with one of them backing down and walking away ... sometimes at a run with the "winner" in pursuit. Be the winner. Tap him on the tail and head with the broom or a stick or even a long weed - and don't leave him until he's moving away from you.