Sounds yummy.  We don't have too many grocery stores that carry a lot of the items listed.  I will have to try a Whole Foods Store or an organic store.
Hey Kuntry, the stores/sources we mainly use are:
Sunflower Market (hippie, yet somehow cheaper than any other store due to their sale rotations.  You can often get blackberries for 88 cents instead of the regular 2 to 5 dollars around here).  We do most of our every day produce shopping here, and our yogurt shopping here.  This is a local chain, I think.  For Noosa yogurt, this is their webpage:
http://www.noosayoghurt.com/contact-us/contact-us/
They have a locator for their product, and you can also contact them.  That said, a similar product may be able to be found or made at home.  
Generic India market/gas station, and a separate Japanese market.  Anywhere there is a sizable ethnic group, you can usually find a grocer hidden somewhere.  We can get hard to find Indian spices from the gas station for a fraction of the price we get in other stores. We always seek these stores out for the variety and price.  One example is that a huge bag of bay leaves cost us $1.50 there.  At the grocery stores, a small spice bottle with a few leaves cots 3 dollars!!  Sometimes the sign names will not be in English, and no one in the store will speak English.  The price rings up in dollars though, so it has never been an issue buying anything.  There are lots of Mexican markets and a South African market in our area too.   
Tony Caputos
We're lucky to have this here.  Their website doesn't have a full listing by any means for browsing and finding similar items elsewhere unfortunately.  We get a lot of our cheeses from here.
Farmer's Market.  I love the one we have!  We have grown to know a lot of the vendors there, and have access to some of them year round.  Our mushrooms come from one of the vendors who has everything from chanterelles and morels to...things I can't pronounce.  He is a really nice guy too, and often will give free samples to repeat customers of any new 'shrooms he has, or anything a customer isn't sure if they'll like or not and wants to try.  It doesn't matter the price of the mushroom.  Many people here are also active in mushroom hunting.  There are local clubs or college classes available in many areas, from urban to rural.  
Honey is shipped in huge jars by my parents.  They live near a family who has amazing honey.  Maple syrup we buy in bulk online.  You can get a ton of really good food online for cheaper than in the stores, even counting shipping.
Field Roast has a website:
http://www.fieldroast.com/where-to-buy
We have a local Goat Dairy that has an honor system store stand where you can pick up raw goat milk, goat milk, and goat milk products.  You sign a waiver for each raw milk purchase, and leave it and any money in a lock box.  We also have a local food co-op that delivers our weekly supply of cow milk and other products and produce.  Some people have started co-ops in their local areas if they did not exist there already. 
The only area my husband and I have lived in together than had...no selection was an area in Virginia.  Large factory farm area, so no local farmers to hook up with, no farmer's market, no ethnic grocers, no sources for healthy anything (the produce was always rotten through too at the one grocery store they had...I even found an onion that was fine on the outside, but completely black and moldy on the inside).  Tons of fast food though.  XD  We weren't aware of how to order food online back then, or we may have had a bit of an easier time of it.  I did not enjoy living in that area at all. 
But yeah, these are some of the places we poke around and look for.  We like stores that sell things like nuts in bulk.  We've been able to eat a lot healthier but spend less than at the major grocery stores using these shops and groups.  Our area does however, have a much denser food selection than most places we have been to.  That said, it is an urban area and harder to raise one's own food.