I don't save anything smaller than 2 inches. If it's a fabric I'm just wild about I will save any scraps that I can work with, even for a crazy patch or something.
But my basic rule I guess is 2 inches.
I don't sort by color but it may be a good idea.