I know what you mean - sometimes even if the quilt is not being pulled by its own weight one way or the other, you find you don't start back up in the exact same direction. Part of this problem is visibility! you can't always see completely the sewing path you were no because it is behind your needle and it is difficult to accurately more forward.
I think the poster who said 'think about where you are going' is good though difficult
advice. I try to stop at a point where I am not in the middle of a curve, but with your photo it looks like that is impossible!
If you are not following a line, maybe you should try marking a little chalk line right where you leave off before you move both your hands around? I just thought of that now, and I will try it myself. My meandering style has the same little quirks yours does.