I think fleece would work well, as long as you used a solid color that won't show through the fabric. You wouldn't have to stitch real close, so quilting could be fast and simple. It won't fall apart in the wash. And you know it's warm! Perfect solution.