Capacitors are a finite item because the materials used deteriorate over time.
Really old capacitors used wax paper as the separator, and those would fail as the wax melts away from hot climates. It's also why antique tube radios shouldn't be plugged in until a technician looks it over.