Don't quit. You have what you need for basics. If you need gloves for FMQ get the cloth gloves with "nubbies" in the gardening department at stores with gardening supplies. They work just as good but aren't as hot to wear.
I get fabrics from mens shirts found at thrift stores. Many times they are new or almost. I have also found womens cotton dresses or skirts at thrift stores that have a lot of fabric in them. I once found a brand new formal on clearance in a western wear store for $12. It was an ugly styled dress and my friend thought I was crazy but when I told her it had 5 yards of very usable fabric for quilting she understood. It also have several yards of very pretty lace (for crazy quilting). All I had to do was take it apart. Put out the word that you are quilting and many people will give you fabric. Granted some of it won't work well for quilting but there will be some usable fabric among the lot. Scrap quilts can be very pretty you just have to be creative.