DO IT -- cleaning up is SO easy! We bought a house with hardwoods. The family before us had 2 children with extreme allergies. Carpet removal made them breath so much easier.
Just keep a broom and dustpan in the corner, and WALLLLLA clean! And you are less likely to step in pins hidden in the carpet.
Julie