Sounds like the advise I got from my beloved Aunt 30 years ago, she was 88 at the time. My husband gets thrilled if I get into jeans instead of sweats when I sew.
As far are worrying if people stop by and catch me "not put together". If they know me at all they will expect it.