You don't have to have batting or flannel. Especially if you use a heavier weight cotton for the backing. I make jackets that way all the time. I get a good soft cotton twill and quilt the pieced parts directly to the backing with nothing in between. It makes them much lighter weight than if there was anything in between.