I like the idea of appliques (strips and pieces) over the fraying areas. If you machine applique, you will add more quilting through all the layers. May I suggest that you increase your stitch length? That is one of the reasons why the quilting lines are popping.