Panne is normally a knit fabric with a pile nap. It is often used for gowns because it drapes well. If the fusible does not have a lot of give, I think you will be OK. The only thing I would worry about is if the panne will take the heat to fuse the interfacing. Check on a scrap first.