How about 3 nights out?
One night you both ignore your other "loves" and go do something like going out to eat, visiting with friends either at home or their place, go play cards, bowling, etc.
One night you do what he wants to do. If he wants to watch tv then that's what you do that night.
One night you do what you want. If you want to quilt then guess what that's what he gets to do also. Start a quilt with him from planning to sewing. Get him involved. Maybe he'll start to enjoy it too.
The other 4 nights are each your own.