I have found that a gentle rubbing with a soft gum type eraser works well and doesn't seem to damage the fabric. As said earlier, don't rub hard. Just a gentle rub over the areas where the pencil marks are. Anything that was left came out in the wash.