I am wondering that if it is a summer baby why you have chosen flannel for the backing.
However, I would still put a thin batting in the quilt. Afterall it will be used also in the winter and the batting will give it more stability and probably will look smoother on the top.