Another thing to consider, what fruits or veggies do you and your family like to eat that are expensive to buy or not available at all, in the store? Usually you can find some variety that grows well in your climate, so why spend the work and use up space in the garden to grow things that are inexpensive in the store (like the more typical varieties of potatoes and carrots that are $3.00 for a 5lb bag) when you can use that same garden space for less-available fruits and veggies?
For us, that's asparagus, garlic, San Marzano tomatoes, Sungold tomatoes, red skin potatoes. I do grow carrots if I have space, though.