Go for it and just spend wisely. Get what you know you will use, and then you won't feel so guilty spending that money. Hubby won't mind either when you tell him how much you saved....after all you could have bought the same amount of fabric at the regular prices. Just don't hoard fabric....use it to it's full potntial.
Unfortunately, the prices will go up so take advantage of anything on clearance, sales or reductions. It's the best way to stretch your dollar.