I don't think that you will find the "ideal" solution. I cannot used insecticide or chemicals that kill vermin--I am highly allergic to them.
My solution to the mouse problem is my four cats--3 males, one female--ALL Fixed. When I kept my horses at what had been a chicken farm, the owner never fed them, assuming that they would feed themselves mice. ALL of his cats were malnourished,
and he had a mouse and rat infestation.
I feed my cats a less than the best dry cat food from
WalMart, free choice---their bowls are ALWAYS full. They've all grown up on the property so it's a "cool thing" to catch mice and bring us the extras as "presents." Seriously, though, a mouse is the perfect food for a cat.
The down side is, HOWEVER, my cats are watching my baby RIR's very carefully. So I have to monitor where they are when I'm handling the chicks or cleaning their cages. My 15 pound male, "Clever" is always catching wild birds. He won't go after a full grown chicken, though.
I NOW live on the edge of a small town with 5 acres that are partially surrounded by farmland. I NEVER find mice in my kitchen, or in my basement pantry---lived there 10 years.
Once I had to go the barn in the middle of the night and I saw a mouse running along the bottom of one of my horse's stalls. I scolded "Favorite", my female cat, because it's her barn and she should have done a better job.
There are lots of solutions out there, and I'm sure you'll find the best for you!