sounds as if they may be the type of dog owner who would leave the dog on account of it costing money.... some people should not be allowed to have animals.
maybe fire a shot over the dogs head the next time you see him at it? might shake your neighbour as well. you have the law on your side.