Besides the ruler slipping, it might be the way you are stabilizing it with your hand and fingers and how you are using your cutter.
Be sure to keep your little finger draped over the edge of the ruler to help keep it steady and press down on the rotary cutter not pushing it into the ruler at an angle making it slide too. Hope that makes sense.
warm quilt hugs, sue in CA