I found out hairspray would take permanent marker off of hard plastic and other hard surfaces when I was a kid. Let's just say I've always been "creative". Later on, I found out that alcohol does the same, and I assumed it was the alcohol in the hairspray that was doing the trick.
So, does alcohol work on fabric? Maybe it's worth a try.
Celeste: I've used both kinds on hard surfaces.