A tiny houseguest

Two days ago, I discovered a suspicious little spot that looked like nibbles at the bottom of a door.  I texted Hubby that I suspected we had a rodent.  A mouse I could accept.  A rat not so much.  I've just come home from an evening out, and Hubby has fallen asleep putting the girls to bed.  I have the house to myself at the moment.  I wandered into the kitchen and flicked on the light, and in the corner of my eye I caught a brief flurry of movement.  I followed it around the corner and found one tiny (terrified) grey mouse.  I am so tickled.  I just want to catch him and put him back outside, but I have no way of explaining this to his terrified little self.  For the past hour, we've been playing hide and seek.  I sit still, reading peacefully, and he ventures out.  Then, he catches sight of me and zooms back into hiding.  I bet he's no bigger than my pinky finger.  So sweet.  But he (she?) does need to get back outside.  Any ideas?

 

Note: after posting, I checked online and found this helpful video.  Heading for the bucket and peanut butter now...