When I was in highschool home ec. My teacher said, material was anything you used to construct with, ie. building material
lumber, nail, etc. Fabric was what you used to construct clothing, quilts, etc. My mother always said "material". I can't see that it matters. I interchange the words....just my thoughts.