Thanks! I just now managed to get it out with WD-40 Rust Penetrant and a wider screw driver bit in a ratchet wrench. The last sewing job this machine was used for involved pink thread!
You tube is filled with guys who get those screws out just by tapping them with a hammer, but I supposed I don't have the magic tap.