Sometimes it's easier, to just touch up the paint.
That said, my first line of defense would be a wet wipe (you'd be amazed, at what those things can do!). Then I'd try gently rubbing the spots, with an eraser. After that, I'd try to find matching paint and just paint over it.