We have a deed restriction but there is no HOA and the county refuses to enforce deed restrictions. They said the only way to enforce one is for the neighbor to sue the neighbor. Most people aren't willing to go that far unless you're really pushing the limits...
