I used velvet as the back for
this quilt and didn't have any problem working with it. My velvet was medium nap, 100% cotton and other than shedding bits all over the floor every time I cut it it behaved like "normal" fabric. I think your fabric performance stress test (high temperature everything) is an excellent precaution!
Alison