I respect your decision. I think we all have to listen to our gut when it comes to things that seem to signal that things are not right in some way. (Hope that makes sense, I am tired).
If it doesn't feel good, it is time for a change. That could be applied to many things in our lives (like when you finally decide to get more exercise or change a bad habit).
I think it's wise to figure out what the fabric shopping might be in place of. You have found a solution that will work for you.
Good luck!
lots2do