I have beeen guilty of saying, "sorry I can't or wish I could because of work". Thinking about it, I may have been rude to someone, because of being jeolous. I wish I could stay home. My workplace is so toxic. Try to forgive her for her rude remark, she may be in the same place I am. Keep up the good work and enjoy what you are doing.