Since it's a reoccurring problem, removing the mice will only be temporary. Best bet, remove the habitat and the food source and they'll move on, just as they did before setting up house at your place.
One thing that has worked so-so ( In our case squirrels ) was to hang one and only only feeder out in the middle of open ground that has no obstructions to flight or sight for long distances. Doing that lures the little rats out into the open where Owls and Hawks can set up on them.
The downside, if you've got Dove's ( as we did - past tense ) hanging around the base of your feeder, you'll have piles of Dove down floating around your yard after a few days.
Around here most of our little critter problems are kept in check by the Coyote, Fox, Bobcat, Hawk, Owl, Rattlesnake and King snake populations. But then the larger of those predators account for a lot of missing cats and small dogs too.
Best, Dave