I was under the understand that in order for it to be technically called a quilt, it has to be three layers.
Quilting only two layers seems actually more difficult than if you had a third layer. Definitely wouldn't use flannel anywhere in the quilt! I'd do as some have suggested and use a thin wool batting since it breathes and use cotton on the top and bottom.