To the OP. I think your husband has issues. :) I feel for you.
I don't look at watching tv as "quality time" together. That would be playing games or actually interacting--not just sitting near each other, eyes glued to the set.
It does sound like he's a bit insecure and jealous of your time. I wish he could have his own profitable hobby. I've never heard of anyone who on his deathbed said, "Wow, I wish I had spent more time watching tv."
I agree, that for most of us here on the QB, we have made a decision to watch less (or no) tv and spend more time quilting or sewing. It's a choice. TV has little value except as entertainment. How much "entertainment" does one need in a day?