There's just no pleasing some people. It's their loss for not enjoying the bounty of your friendship. You sound like a good person and a good parent, so it sounds like their problem is jealousy. If I were you, and I have done this with neighbors of my own, I would continue speaking and being friendly because you know you're doing the right thing. If they have any conscience they will be ashamed of how they have spoken of you.
Susan

Susan