Funny, I just had this problem with my 'new to me" Featherweight. I had bought a 1/4 foot with flange that was supposed to fit. NO way. The foot wiggled!
So, a friend and I came up with something that actually works. I have a seam guide that screws down on the machine bed but material can get under it. Sooo, We put some of that orange plastic guide strip, cut to size, under the seam guide and it works! Now I have to put down painter's tape to mark the bed as to where to put the guide when I need it.
On my Pfaff I just use the 1/4 guide foot with a flange and move the needle over for a scant 1/4" when called for in a pattern. I did enlarge the hole in the foot with a little round file from Home Depot. It works well even with the single hole throat plate.
ali