I agree, the bobbin case does not look like the correct one. Hopefully you have found a picture of a featherweight bobbin case so you can compare. The needle does go in with the flat side to the left and threads from right to left. I am pretty sure that your problem lies with the bobbin case. Good luck and happy sewing.
Pat