check to see if your needle is inserted in the sew machine the right way round

Mine did that and it was the timing. All is well now.

Sounds like your bobbin case is not aligned with the bobbin race.
I would take it all apart again...and carefully put it back together making sure everything was lined up correctly.
Kirsten