I would use a live mammal trap and empty the mouse further down the garden. If I wasn't happy about doing that I'd use a break neck trap. I wouldn't use a glue trap.

I have to add that I very rarely have live mice in the house - about once every few years. And therefore I'm not particularly inclined to attempt the impossible task of eradicating them from the garden.