I would put the backing and a muslin back on just the panel then quilt it. Then put your full batting and backing on the entire quilt. Quilt around the outside of the panel and then do any FMQ you like around those seam lines to hold the back to the quilt.