When you put the bobbin in the bobbin case, whether the case comes out or is one that stays in the machine, the thread should make a U turn from the bobbin to the slot the thread fits into. You also need to be sure the thread is securely in the slot. If it slips out it can really make a mess.
Hope this takes care of your problem!