I have mine by color. They are stacked in a bookcase where I can easily see them.
Someone suggested, if you bought fabric for a specific pattern, to bundle them together with a ribbon and the pattern so they stay together and you don't grab a fabric intended for something specific.