Like paper piecing, when sewing onto register tape, you should be using a shorter stitch length. That will help get rid of the paper. But it's too late for that. A seam ripper can help in reaching those small pieces of paper. Maybe someone here has a better idea. Putting another piece of fabric on the back for washing might help. The paper didn't come off in the dryer?