I've collected fabric for years before I started quilting. So mostly I have the fabric and figure out what to do with it.
Of course I see quilts I like and then put fabrics into the design and discover I need one or more fabrics I don't have. So it does go both ways.