I have a singer and I have that same issue...but as a newer sewer I think part of it is my own user error
I have noticed though, that my quarter in foot wiggles a LOT and I often find my seams slowly moving as I stitch.
I have a bigger issue with the 1/4in foot that came with my machine, I use a Janome 1/4 foot that has a guide...it wiggles less and is easier to control when the fabric starts to wander.
There is some very good input on this thread