After I trim to square off the edge, I flip it around so the bulk of fabric is to my right. I use the ruler for measuring. I do use the mat lines if I have to cut something larger than the ruler's width.
I would think if you ONLY used the mat's lines, after a time the lines would disappear and you'd have numerous grooves that your cutter could end up in and distort your cut.