You can buy
sew-on velcro, without the sticky stuff. It's very machine-friendly!
For removing the glue from your needles, get yourself a small bottle of Goo Gone. Just a drop, on a piece of paper towel or tissue, will clean your needle. It's also great for removing price stickers, etc.