Not only can you, but you should! Once you get past little fears like that, you'll be ready to tackle even scarier projects, just in time for Halloween!
To get the little finger where it needs to be, raise the presser foot, remove the screws holding the needle plate in. Take a look, and remove any thread jams lurking there with tweezers, or a toothpick or maybe a little crochet hook. When you reinstall the needle plate, just align that little finger to go into its home position like the picture above.