I don't feel guilty, but I do get regretful and melancholy if it's a store I liked. I suppose I might feel a little guilty if it's a store I never went to until they were closing out, but not if I didn't go there for a REASON (like bad service or outrageous prices).
In this case...you're helping this lady out by taking home fabric so she doesn't have to. If I imagine myself in her shoes, at this point I think I'd just want it all to be over and done with so I could move on to something else. Think of it as converting excess "stuff" into cash for this lady for her next adventure and maybe that'll feel better?
Sorry you're losing another local shop, but I hope you find some good deals!