How about those adhesive lint pickers on a handle, they make all sizes, surely one must be under $5 and most of the rest of what I would suggest has been suggested already!
I recently purchased an ergonomically styled seam ripper--I love it. It has a larger cushioned handle which fits my hand with rheumatoid arthritis. Love it! Also flat headed pins are great.