You're not alone!
I feel the same way, but it's because I am 'color challenged'! What I do is buy kits or go into a fabric store, find a fabric that I really love and then ask for help getting coordinates. It's also helpful to have a pattern in mind...