When you keep animals, it is an attractive nuisance. You need to draw a clear line about trespassing upon your property. If anything happened, you would end up on the nasty end of a law suit.
Be firm, but nice to trespassers. You cannot set traps for them; that is illegal. However, you can...