Just a guess, but I think your ruler is too small. Try a wider ruler and see if there is a difference. For me, the smaller ruler will tend to try to throw itself all over the place. With a wider ruler you have more to hold with your hand to keep the ruler and fabric straight, even as you are placing the ruler on the fabric.