When my kids were that age, I couldn't sew until they went to bed. (I had 4).
Perhaps you could schedule a "play date" and sew, and then repay the favor. We did that a lot when I was raising kids.
Don't be hard on yourself. Raising kids is hard work. It's easier to go to work than raise kids, IMHO.