If you've taken off the throat plate, the bobbin case is left to rotate freely. When you put the throat plate back on, you need to make sure that the position "finger" of the bobbin case base enters the notch of the position plates attached to the underside of the throat plate.