If you are having problems with mice in your house, once you have gotten them out of your house, you want your house to be less inviting. Make sure you board up and plug any possible entrances that mice might take into your house. You don't want them getting back in once you finally get them out.
Now, where you know mice have previously gained entrance, plus near all your doors, plant the herb peppermint in all of these places. You can also add window boxes outside windows where mice have previously gained access. To pretty it up, you can add peppermint with other flowers. And not only do mice hate peppermint, it will make your entrances smell great the the scent can waft in through the windows when they open.