I broke down and tore apart the other lamp.
OK for anyone who needs this in the future, the answer is it DOES belong there. It's just a small circle of black felt with a hole through the center to allow the screw to pass. It must cushion the lamp a bit to avoid chipping the bakelite.