I've done both - started with fabric and started with a pattern. When starting with fabric and there are several sizes involved I tend toward either scrappy, log cabin, or any of the wonderful books that work with layer cakes or jelly rolls. I'm excited to see where you head with your project - love to see pictures!