Oh I'm sorry that happened to you...I just hate rude people! I usually just turn to them, smile sweetly and say "Pardon me?????, did you say something to me??" They are usually too embarrassed to repeat it, but if they do, then my next response is "why would you say something like that?" They are usually ready to get away at that point.
I really hope your next museum experience will be much better..