I hope I can help. It looks to me like that is not the correct bobbin case. It should not move when you are sewing. They are thinner then most modern ones and so are the bobbins.
One note is there is one more thread guide at the top of the needle that you missed. One of mine is picky that it doesn't want to miss that one.
Also, you may need to clean in the bobbin area. I would suggest taking off the needle plate and clean and oil the race.
Good luck. Vil looks like a charmer.