Three ideas (not that you seem to seriously be looking for them):
1. Non-lethal traps (as you mentioned). Something to capture the critters so you can release them in a field somewhere else.
2. Seal up all the holes in the house, especially the pantry. This should be obvious regardless of what you do. Steel wool in small holes can do the trick. Otherwise more permanent solutions to seal holes and cracks are needed.
3. Sonic mouse repellents. My gf uses several in her place after she had a mouse (she is terrified of them) and hasn't had an issue since. This is a different brand, but same general concept: http://www.victorpest.com/advice/all...-of-repellents
And if nothing else, don't get glue traps. Those are far less humane than simple snap traps.