Quilting is fun, relaxing and some is for charitable gifts are to raise funds for the church (the Lord's work). So YES, I quilt anytime I want to and have never felt any guilt for it.
My sister in law has a saying about every stitch put in on Sunday will be ripped out as it is the XXXXX's (bad guy's) work.........
I consider that something her Mom taught her. We sewed on Sunday at my house and embroidered. We did things we enjoyed.