we rotate all of what we plant, since we have plenty of space, never the same thing in the same place for 2 years at leastHmm weird. Do you plant tomatoes every year? They say you're not supposed to plant tomatoes or other nightshades in the same spot the next year.
I don't use fertilizer either but I did buy organic potting soil to mix in the hole and I also bought Espoma Garden Tone which is sort of an organic fertilizer and works well for me. Next year though I am planning on planting in the old chicken run/now compost pile and likely won't use any fertilizer. Do you have any compost or old poop you can add?