It's different for everybody, but for me, I need a piece big enough to cut a 2" square from, or if it is a strip, I will save it down to 1" wide - to use for string blocks.
I have a sister that does applique though, and she saves very very small pieces.