Thanks for the suggestions! I didn't think about the weight or drag- that makes a lot of sense. I'm using a walking foot, so some of the free motion foot issues that were mentioned don't apply to this situation. I tried to adjust the weight better and it seems to help. This might be a really good lesson in not using two different colors, though
