Gee I'm sorry to hear that he doesn't like that you take time to quilt!
Can you quilt in the same room or nearby while he watches tv? I think I might understand how he feels, but only cuz he doesn't seem to have any 'passion' for his own hobbies.
My hubby supports my quilting in every way, even suggested that I use the main part of our huge master bedroom for my 'studio' while we use the comfy cozy retreat off to the side for our bed.
Hopefully he will mellow and realize how much joy your quilting brings you ... and as you said he should want you to be happy cuz then you'll be more apt to make him happy. ;-)
warm quilt hugs, sue in CA