There are always the places where people are selling or trading items. There is a selling board on here, or the SewITsforSale yahoo group, where people list items for sale or are looking for items.
Always try to get the best you can afford, but getting something used or at a discount place like jhittlesewing.com or using coupons at JoAnns works too as long as you know it's a decent quality.