DH had a pension when he retired, I retired early and did not. I worked part time until I could take early SS (we decided it would take too long to recoup the difference if I waited until the "magic" year). We get along although I do wish we had the house paid off. We got a really good investment adviser and he has helped us keep growing what we have even though we do have to draw on the IRA.