I have done this and have been happy with the results. The first time I was putting blocks together and accidentally put the fabric on wrong, really liked it and used it throughout the quilt. The difficulty came, probably from muscle memory, where you just immediately put right sides together. I had to keep reminding myself that the wrong side was the right side.