I'm getting better at it. I just recently tossed a pile of miniscule scraps that I couldn't work with.
If you have trouble letting go...you may want to ask around to see if there's a quilter who loves to do crazy quilting.
I had an elderly cousin who took the tiniest scraps and hand-sewed them to make tiny teddy bears to give to children. She gave me one and it's one of my treasures.
It could be a great activity for those in assisted living. With that said, I need to save my scraps again. :)