I don't have an answer, my DH complains about my quilting, fabrics, threads and everything related to quilting but I discovered that is just because he is jealous. He would like me to be sitting by his side watching his TV programs which I don't do often.
I learned to live with it and learned to ignore his comments. When I am quilting I am enjoying all of it. Do the same and think that maybe they just want more of you and your time with them and less with your fabrics and toys.