I've used both and don't like either! The flannel makes the quilt heavy and thick, and the fleece STRETCHES when you try to quilt it. After quilting the fleece, it feels hard from the stitches and not fluffy at all.
That's my two cents worth of experience.