I sew a lot with fabric from Walmart, Hancocks, and Hobby Lobby. Hancocks always has lots of sales, and Hobby Lobby has a 40% coupon in every Sunday paper. I think it is available online also. I buy my batting at Hobby Lobby with that coupon, usually 10 yards at a time off of the roll there.
Connecting Threads is a good place to buy online.
I very rarely pay LQS prices, just because fabric costs so much there. I have to really love it to do that.
Don't give up on a great hobby. It's too much fun and can be done without costing an arm and a leg.
Dina