Thanks meyert! I didn't want to use the interfacing as its to be a cuddly wrap and I didn't want it to stiff. Will have to use a big loopy quilt pattern.
I just had another thought, I have fusible batting that I use on things like table runners/placemats. Might just try a bit of that with extra knit fabric and see how it works.