I would file a report with the fair,4-h,and wherever else I could.Let them know the actions and behavior on this man.Put them all on notice that these letters can and will be use in future legal action WHEN(NOT IF) this man harms people(likely children) and animals in the future. People don't like it when you point out that they can be held liable for the stupidity of others by doing nothing. If you do not write anyone about this then they can claim they knew nothing about how he is acting,or what he was doing.
He reminds me of an abusive spouse.The abuser may only target the spouse,but the children seeing that abuse ARE affected by it. Just seeing how this man is acting is bad for the kids,and seeing no adult step in is also in their minds telling them what he is doing is OK.