Sigh! I can only imagine. My focus is to organize what I have now. The thing is I like putting together small pieces of fabric so I keep them. There are styles of fabric or things I have outgrown that need to move on.
I think the idea of what will you want to sew with is a what others have said and is a good place to start. Also, donating directly to charity quilters who will appreciate your fabric.