I did the very same thing on a pieced back. I had a few squares left over and put them together in the center with other fabric around them. Very proud of myself. Put it together, quilted, put the binding on, showed hubby. He said "why is there a swastika on the back". What????? I hand stitched another bit of leftover over the center and it isn't as obvious.