Rachel,
It's not a bad thing. If you are happy buying it when you need for specific quilts, then do it and don't try to force yourself to be different. I really only have one vice - fabric and I thoroughly enjoy the collecting part of the hobby. But if you don't, that's great too.
We're all different and that's great!