I've never felt the need to punish my husband, (nor does the other way around happens). He's not much into fabric so most of the time I go there alone. But he loves craft stores as he does oil painting and we do a lot of crafts together. He also knits hats for the homeless and when we aren't given 'leftovers' he has to buy his own when skeins are on sale. Neither of us are over spenders and rarely go on a binge for anything. I buy what I want, he does the same. It seems to have worked, we've been married over 50 years.