I think it would be easier to just cut the three layers the same size.
It might depend on how heavy your flannel is. The chamois type of flannel is extremely dense and heavy and some flannels are almost gauzy.
I think if the raggy part is turned toward the body instead of toward the room - it would sort of trap air and act like insulation.