I see nothing wrong with what you're doing. You're creating a lovely environment for your own family. Nothing wrong with that or selfish.
Just as a suggestion, every now and then make a quilt for charity. There are quilts given to children in hospitals. My
thirteen-year-old granddaughter has just been diagnosed
with cancer, and while she was in the hospital getting all
kinds of tests, she was given a quilt. Check in your local
area where you can perhaps join a local guild who makes
charity quilts. A guild I belong to makes pillow cases for a
local nursing home. They are easy to make and don't take up
much time.