The felt in the bottom of the machine is often funky too. I vacuummed the bottom and the case, and put in scented dryer sheets... My machine also had signs of insects in the felt compartment so I was happy I vacuumed it quickly.
But it still stunk a bit until I gently cleaned my machine with a sewing machine oil and a soft cloth.