If people are allergic to walnuts, poly pellets are a good substitute. They are good for weight and are cleaner than some things.
Pins slide in and out of polyester batting very well, but my pincushion filled with poly batting won't stay put.
Pins slide in and out of wool very nicely, too.