I leave the pieces with no problem. Since I use the satin stitch it makes removal of bad stitching very easy. The little piece of stabilizer takes care of the ripper point so it doesn't tear fabric when removing satin stitches. If it really bothers you, use wash away stabilizer.