I agree, if you wash it first be sure you have it basted to backing or something so you won't have all the ravels and possibly ruin part of it.
I used Shout to get ink marks out of some fabric I had after trying everything else I could think of, don't know if it would work on pencil or not.