Carol Doak says the same thing; don't worry about the little bits.
I tend to remove the seam pieces as the I sew sections together. I think that helps a lot to reduce bulk while sewing and makes the paper removal process at the end, less troublesome.