What brand of 'chalk' and what color do you use?
Some 'chalks' have a wax/grease binder in them.
Some colors, like blue and yellows, seem to be much harder to get out.
I personally use a white chalk powder thing called a Chaco Liner from Clover that I've had great success with.
Joannes carries the blue and yellow; avoid those.
Jan in VA