When I use to sew quarter inch I had to do this on 2 of my quilts. Don't do that anymore, use the reg sewing stitch for clothes.
What I did wAs PUT SOME FRAY CHECK AND THEN SLIPPED THEM INTO next piece like they were or slip stitch or invisible stitch and slip the pieces next to fabric that it touched.