I almost always pick my colors first and then my pattern. I know this is backward to the "norm" but after making a lot of quilts, I have gradually changed over.
When I taught Beginning Quilting 101, the participants all made "Trip Around the World" quilts, lap size. They needed 5 fabrics. I had them pick a fabric they liked and then to quickly pick more fabrics to go with what they liked. They might pick out 10 or more fabrics. Then start narrowing done, looking at a distance. At times they might even eliminate their original focus fabric.
Picking fabrics is the most fun part of quilting. Enjoy the process and you can always ask for help in the quilt shop.
Barb