The open well was there prior to the new owner's purchase, wasn't it?
I might not be okay with a saw mill next door to me, or a gas station or food mart or feedlot. But one thing I know for certain --- I don't own the scenery, and I would be very upset if my nieghbors tried to restrict what I do on my property.
If the survey was in error, you have a legal recourse, hire your own surveyor. Then do what you have to do to get your property back with compensation for destroyed shed.
Using YOUR driveway. Also once again if it is indeed your driveway, no way no how can they tresspass unless you allow them to.
I suspect that the driveway is a deeded right of way or maybe an easement.