In my experience, rosemary is very easy to grow. -guess it depends upon your climate and soil. Anyway, I'd give it a try! Good luck on your herb garden!!(maybe rosemary... i heard it was hard to grow?)
Hubby wants to try strawberries, blueberries, blackberries, red raspberries, and to plant a couple apple and mulberry trees.
The strawberries and blackberries grow like mad. Make certain that your soil is acidic before planting blueberries. We container ours in large whiskey barrels and plant them in pure peat moss. Thus far, we've enjoyed a good yield of fruit.