I prefer to use peanut butter on stickers, that being said, I always use it on dishes/hard items. I let it set for a couple hours and then the sticker comes right off.
If you work from the back side of the fabric, like Jordan suggests using hot water with soap (dawn) and scrub with a toothbrush. That way you would not be pushing anything 'into' the fibers.