I was sitting here thinking about all the answers and I turned it around in my head and wondered what my DH would do if I was "gone". We spend a lot of time together as a married couple and as best friend.
Poker, golfing, visiting family in the Midwest, more poker and golfing. Might take up fishing again. Watching the shows on TV that he likes and I don't. Lots of sports. He'd miss me but he would have lots to do.
So, I feel no guilt in knowing I would attend lots of retreats, travel, and quilt as much as I like. Building my stash up too.