I do feel that way occasionally. Sometimes it means that I feel disorganized and I have to spend a week or two trying to organize it all. Sometimes I don't have the desire to get that deep into solving my problem and then I pick 2 or 3 projects or WIP, pick out the fabric for those projects out and put each in a container (so those projects feel organized at least) and then shove everything else in the closet where I can't see it and shut the doors. Instant organization or at least enough to let me get started again until I am ready to really clean up.
And I do try to go through my fabric once a year and get rid of anything I know I will never use. That's always helps too. Good luck.