If you feel you are spending too much time sewing, then cut back.
For me, 5 hours a day on the weekend would be less than half what I normally put in. I find that if I don't get a lot of sewing time, I start stressing out about my job. Sewing is how I relax. I'm not programmed to sit on my behind to relax, I need to be doing something.
My husband is the main housekeeper at this point in our lives, so that frees me from most cleaning and cooking. So the hours I am not dealing with my job, I can pretty much do what I like. And right now, that is playing with fabric.