The tote bags I make are usually from drapery or upholstery fabric. I tend to use some of those "why did I buy this" fabrics as the linings. In most cases there is no need for additional stiffness.
The very large one I made from regular quilting cotton would have been much better with either a fairly stiff Pellon or a fusible like Craft Bond inside.