When you free motion, do you use a foot that hooks over the needle screw? If so, that is working the screw loose. My walking foot has a small plastic piece that fits over the round part of that screw and it keeps the overlapping part from loosening the screw. I hope this explanation is clear!