I put mine in an old medicine bottle. They do not fall out & I do not worry about anyone being stuck by a needle.
I also save the holder of the cutter blades. Mark on them used & new and discard them in it. They are dull for fabric but can still hurt someone if they come through the trash bag.