You can try rubbing alcohol or acetone-based nail polish remover. Start by dabbing a little amount of rubbing alcohol into a cotton cloth to remove permanent marker from a desk. To remove the residue, lightly dab the area to moisten it. Then, using a wet towel, wipe the area clean. If a small mark remains, simply repeat the procedure.