Yes, it can cause damage. Years ago, I saw a story about a murder mystery on TV. They had trouble identifying the victim and finally tracked the name down by the small notch on one of her teeth from holding pins. She had been a seamstress.
I usually put them in my shirt but that habit has got to stop also. I forgot one and almost stuck myself in the eye when I pulled my T-shirt off over my head. WoW, who thought sewing was such a dangerous hobby.