If you have masking tape, wrap it sticky side out around your hand several times to get a wide enough surface to do some good and just pat your design wall and let the tape pick up those stray threads.
Or of course you could pick them off one by one..,,NOT!