I only use the fusible to stabilize while sewing the t-shirts together. There is an on line t-shirt quilt maker that doesn't use fusible at all. I think you are fine with it only fusing in places. As long as your edges aren't all stretchy and curling up you should be ok. Go for it.