I hate to say it, but chances are you've already got them in your house, mice are so good at getting into houses, it's almost impossible to mouse-proof a house. We had them in a 1970s subdivision house! We know for sure we have them here, or had them, but our house also sits over top a cold cellar.
Mousers, cats, are an excellent idea, raise them from kittens, try to get barn kittens all you have to do is give them a nice place to sleep, dry, and remember to spay, and provide them with their rabies shots. We give our barn cats a little bit of food once a week, just enough to supplement them in the winter, and they get rabies shots, and are fixed.