Sometimes for your own mental health, you have to draw the line. My mom, growing up in the depression, saved everything. It physically hurt her to throw anything that had a use out. Growing up with that was sometimes difficult. We had an entire drawer full of rubber bands, strings and refolded tin foil. Now I don't believe in tossing everything, and have a tendency to packratitis myself,(I think it is possibly genetic LOL), but I set out a few rules and periodically go through things and pass them on. Sometimes it's as simple as if I haven't worn something in x years then it goes to my favorite thrift. Same with scraps or even fabric that I can't remember why I bought it in the first place. There is always someone at my guild who is overjoyed at getting it for a project or comfort quilt.
Never feel bad about making yourself feel better. :-)