I always pick fabric first, and let the fabric inspire me. But then again, I don't follow patterns..
I would assume the best thing to do would pick a pattern then get the fabric to use on it..but then again that doesn't leave you much of an excuse to buy fabric that you don't "need" yet lol :)