I know in my area machine repair shops are far and few between but this is most definitely the way you should go. This is risky business if you were to try to fix it yourself. Take it in and be safe.

Amazon has many listings.
Amazon.com : sewing machine needle clamp screw

Ash, welcome to this board.