To heck with the lint roller - get some wide packing tape - make a large loop sticky side out around your hand and "pat" away. It is MUCH stickier than a lint roller (now you wonder why I know this . . . LOL) and works so much quicker and easier (at least for me).
Before you "rip out" next time - I have found if you have loops on the back, if you clip the back thread once where it goes around the curves - the piece of backing thread pulls out easily. Then the top thread is not held down and it too pulls out in a long strand.
Sorry - Good Luck!