I'm having the same problem. I wear a couple of zippered sweatshirt things for warmth and comfort and one of them is a magnet! I have to pull each one off. The washer and dryer do nothing.
Your idea is hilarious!
I probably will just pick and complain but you should go for it!