I'm not sure why people would prefer a fabric truck with limited variety to the internet. If you can get mail, you can get fabric via the internet.
So, IMHO, I wouldn't do it. It sounds like too much work for something not really needed. Many, many people live in a place where they have to order things via the internet. Unless you have people asking for such a business, I'd think it wouldn't be profitable enough to do as a real business, and if you decided to try it on Sat/Sun...is that how you want to spend your only free days?