i believe fabric is the better term if you are indeed referring to fabric. Material can have many different meanings about type, quality, etc. For instance you might say "the materials used in quilting are - needles, thread, rotary cutters etc. I am not a gramarian but believe this would be clearer to me.