When I've made tote bags, I like to finish the seams with a french seam to give the tote added strength. With that in mind, duck canvas AND batting may be too much for the cotton. Why not ditch the batting and just quilt the cotton and canvas (Canvas for strength inside and cotton for color and looks outside).
You'll get the same look (maybe not as Poofy) and it will be a lot easier to construct (not so many broken needles from the thickness of the folded seams).
Just remember to finish those seams to add to the strength of the tote.