Success!

Well, after a few days of feeding mice peanut butter and being outsmarted, I stepped up my game; I switched to a bigger garbage pale. The mouse apparently ate even more of the peanut butter, but didn't make it away.
Apparently, the other contraption was allowing the mice to feed and walk away. Hopefully, this is the start of a mouse-free environment.