I'm with you, a sharp blade always feels so luxurious it makes me wonder why I didn't change it sooner.
I store old blades and pins in an empty tea tin. When it's full I take it to the drug store for the sharps container, although the pharmacist wouldn't handle my last batch so I just might find a container in a public bathroom and use it.