I also have a huge stash, and I know how you feel. I keep most of it in a different room, away from the sewing room. In the sewing room, I have only what I expect to be using in the next 3 months or so. There is a lot there because I do a lot; I have finished two adult-sized quilts this week so far, and that includes the quilting. However, the fabric doesn't bother me too much since it is all organized. In the fabric room/shed, it is organized by color. In the sewing room, it is organized by project. When I finish one project, I start another, even though I usually have a few going all the time.
So my advice is to organize your fabric, and then get it out of sight. Put it behind curtains/a design wall if need be, since it seems that seeing it is what stresses you.