Pretty much.
It's not always easy to move, but this is exactly why I bought the house I did. I searched everywhere for unzoned property before settling on a rickety old house from the 50s with all original electric and a kitchen from the '70s all so I could have chickens and build whatever I want. My commute for work is pretty long as an additional personal cost, but it's so worth it to have the freedom to do what I want when I want and how I want.
We did the same, except our old farmhouse was built in 1906, and the property is zoned agricultural. It was a LOT of work but well worth it in the end.