What you did was fine...
Don't let some sort of guilt overtake you. It is your life, your house, your closet. You can do with the scraps what you like.
But a hint for the future. Fill up a bag (one of them), post on here under for sale (cheap--like $5), or donations and I'll bet it will be gone before nightfall. Someone who lives near you will probably get a speeding ticket coming over to relieve you of your scraps.
:)
We don't all have to enjoy doing scrap quilts. Think how boring life would be if we were all the same!