HaHa - I had to laugh at your dilemma! For years, I sewed for my kids, and saved the scraps, hoping that one day when retired, I'd have a chance to make them memory quilts, and do some fun things with my fav. materials. Well, life got in the way, and things were all akimbo with a divorce, and new work, and grown kids, etc, so I sold all my stuff in a gigantic garage sale when I came here 17 years ago. Then I met the neighbor, who is a quilter, and wanted to start a quilting group! Of course, I wanted to participate, but had to start all over again with fabrics. It all worked out, but I thought it was quite an irony that finally I had the time to do what I wanted, but had to start over again!
All that said, I firmly believe that each person has to make her own assessment of what must stay and what must go, and trust the cosmos that it will all work out in the end ---- and it does!