My stash is close to "out of control" and I am forcing myself to use what I have rather than add to the insanity. (Oh yes, I love fabric shopping a little too much)
When I decide on a patter, and I find the focus fabric, I always find something to go with it. For me, it is important that there is no color distraction. It sounds like the closet overwhelms you. Why not pull a few candidates out and audition them away from the closet. You'll be surprised.
Of course if you'd rather go shopping...we want to see pics!