You might try ironing your fabric first too. That might help. Also use a sharp razor blade in your rotary cutter. Don't try to cut a long strip with one cut.
What I mean is...walk your hand up the ruler. Start your cut...stop...walk your hand up the ruler.....start cutting again. This way your ruler won't move. Hopefully your cut will be straight on.
Please let us know if this helps.