I've been making scrap quilts lately and everything frays. I make sure I take off any dark threads that might show through a light fabric, but I don't pick up anything else. They really look like a mess from the back, but after they're quilted, they look just fine. I wouldn't worry about it.