I put needles into my pincushion like I'm pinning fabric. Both end are exposed. I try to put them back in whatever pack they came from when I'm finished sewing.
I used to have a habit of using the arm of the lounge chair as a pin cushion. After leaning on it one day with my hand and finding 2 needles the painful way I was cured of that bad habit.