So as long as I try to stay away from gmo's and soy, there should be an improvement in taste?
No, that is not the case. The improvement in perceived taste is usually due to the increase in carotenoids in the yolk due to consumption of greens when free ranging.
Simply feeding non-gmo or soy free will not magically change the flavor of the eggs.