Joann's has a selection of nicer, heavier flannels that are not with the juvenile flannels. They are called Quilter's flannel. They cost more, but they are heavier and do not pill or shrink quite as much.
When I use a layer in the middle, I just use any flannel - no one will see it. lol