My husband has gotten the red chalk on tee shirts and I like to have never got it out. The red dye left a light stain on his shirts. I don't know about other colors.
Edited to add: I wonder if the pounce powder could be used in one of those carpenter's chalk lines?