Most of the time, DH is with me when I'm buying fabric, so he already knows I'm buying it. And most of the time when he's out buying supplies for his hobby - I'm there too.
I just got my stash some what organized - in that it's all in two locations now (Yardage in one and scraps in another). Maybe this way I won't have accidentally hidden it from myself!