You are correct -- the colored chalk is a little difficult to remove. Try diluting the colored chalk with white chalk powder. When I use the pounce pad, the color is just barely noticeable. I just put a tiny bit of colored chalk in a container and then add white until I think it is right.The "recipe" is approximately 25% color to 75% white. Another note about this -- I was told not to use the yellow chalk because it is the hardest to remove.