Like others have said, it's the way that machine is suppose to work, to the only way to "fix" it is to get a machine that is not left homing.
If you are looking at a picture of a vintage zig-zag sewing machine, specifically look for a knob with LCR positioning. if it's got that, you get to decide where the needle is for straight stitching.
It does not make a big difference if you are sewing clothing with a 5/8" seam allowance.