I've not had a negative comment about my charity work. I've had a few "that's alot of time and money"; however, it is my time and "our" money. I usually just say "that's true but it so blesses my life".
How sad anyone would have such negative feelings about us giving of ourselves to bring comfort to others.