Yes, the thread is supposed to stay in the fork.
One thing you might look at is the positioning of the fork. I have had a couple of machines that have had that retraining fork installed in the wrong spot. It should be at about the 1 O'Clock position.
If you take the tension mechanism apart, you will see a little tab on that fork ring, that fits into a slot on the body of the tension mechanism.