It's the oil in the peanut butter that loosens the adhesive. The solid part of the peanut butter holds the oil in place on the adhesive so it has time to work.
If you carefully peel the sticker off you should be able to use a little oil to clean the residue off.
Rodney