The projects I work on determine what my remaining fabric looks like. More often then not, I do what you do, but not always. Thus, I have a few wonky cut pieces of fabric in my stash; I only trim off & throw away pieces that I know are too small to use for anything that I might make. (And I save for applique work, too, so what I trim off & toss is REALLY tiny.)