Fabric is a more specific name, since material can refer to all kinds of things. When quilters talk "material" we know we mean fabric, but other people might not know what kind of material we're talking about. Imagine telling a friend you went to the store to buy some material - would they think building material?