Our bones press more tightly together as we age due to gravity, thus we shrink. Osteoporis can make it worse in some cases.
I was just googling this and found it interesting that even in one day we are taller in the morning than the evening. This has to do with the water in your spine being compressed by gravity.