There may be a little shift, but not a whole lot. How closely did you pin? you should not be able to put a fist down and not touch a pin, so like about 3-4" in all directions. Also, did you always sew in the same direction? You should be sewing one row one way and the next row in the opposite direction. If you can post a photo it would help. It may not be as bad as you think.