I don't know about fusible fleece!
My big concern is how thick of a sandwich you will be sewing. Most totes have you fold the handles into a roll or into thirds so they don't break. Your picture shows pockets, which also are a sandwich of cotton, batting, canvas. That's 6 layers of material to work with on a simple seam and up to 12 layers of material when you go to attach the handles.
That's pretty thick.
I've made totes/backpacks with wide wale corduroy, ripstop nylon, prequilted fabric and denim. I have made my own pattern, based upon what I want to put into the tote. I usually triple roll the handle, and make sure it completely goes around the bottom of the tote in a continuous loop so I get the most wear out of the tote, since the handle connection is the thing that breaks first - that or the bottom corners of the tote.
Go for it - however you want to make it. These are just things to think about as you plan what you want to do with the tote.