Mice have no purpose (that I know of) other than to eat and repopulate so there are lots of them to provide food for the multitude of animals that survive on them. You probably have more out there than you realize.
The best weapon against mice is a trap. Bait it with peanut butter. If you're lucky, a fox will come along and eat the dead mouse during the night and leave the trap.