I also wondered if hairspray would take it off. But hand sanitizer seems to work well, so, definitely try that first.
While we are discussing permanent marker, has anyone found a way to get it off cloth? Specifically, a sock monkey that I made for one of my grand daughters whose younger sister marked up in a revenge fit?