I did toss out a bunch not too long ago, but those were, unfortunately, used for mouse nests, I had no choice.
I never get rid of fabric, simply because while they may not be good for quilts, they might be good for something else. There's always pot holders, mug rugs, coasters, anything small that can stitch up quick and I'm not worried about how long they last because they're mine. It does give me the opportunity to see if a fabric would hold out longer than anticipated, pot holders and the like are used daily around my place.