I think I would go ahead and use them. I love the CW colors and think you might really like it once you're finished. You must like those colors to have them in the first place, right? Even thought most GFG's are in pastels or florals...this is your quilt. Do it your way.
