I don't think your neighbors are lying. You already said he hates cats and isn't eating at home. Your neighbors must be passive/aggressive freaks. Feed him, then want him gone? Weird.
I don't know why you're waiting to "catch him in the act". How will you train a dog that way? Staying on...