I have done it before with a fleece blanket and had no problems. My back came out smooth.
Try it on a small part and see what happens.
One thing I have found is that you need to follow the directions on the can when it says to use at XX temperature. If the spray is too cold, it doesn't adhere as well.