I have the same problem. I also have a Brother. I have foam tape as my 1/4 in guide, so I put my fabric right up against it but it always have to hold my hand on the fabric to keep it from veering left. Its annoying, and I also thought it was my lack of skill