The danger with asbestos is when the flakes become airborne. If you're concerned, be sure to wear protective gear and probably do your work outside. Otherwise those flakes can settle and become a problem again when disturbed. Vacuuming and sweeping are also a bad idea for the same reason. We had to hire an abatement company to remove an old furnace that was covered in asbestos. The whole house had to be sealed off from the area where the removal took place. Of course, you'd be dealing with much smaller amounts but better safe than sorry.