I agree, garage/yard sales are awesome. I got a sewing basket for $3.00 once. Inside was a good pair of fiscars scizzors, 2 nice seam ripers, plus pins, a new pin cushion.
Thrift stores are great too. I watch for baby blankets and make lap quilts from the, for next to nothing.
I use toilet paper cardboard to wind my binding onto.