I think you should do what makes you feel comfortable. There is no "right" or "wrong" in this.
My mom collects china sets (as in sets of china--English and German, mostly). My sister's family collects "antique toys", my husband collects tools, etc.
If that is not something you like to do, by all means DON'T. If you want to, go ahead--it's your life, your house, your totes, your style of sewing/quilting. There are plenty of people who do only one project at a time. Your totes might be better off holding sweaters or cleaning cloths, etc. (or whatever you want--or NOTHING--you can give them away too).