Your controller probably needs adjusting. Older controllers were made to have both slow and high speed. As they get older, the parts don't move as they should.
Andy Tube does a Singer 401 controller rebuild on youtube. It just involves cleaning and lubricating, if I remember correctly. (I have a 401 controller that wouldn't do low speeds.) I would assume your controller works the same way.
bkay