From your description and the online reviews of fabric stores in Stone Mountain, it appears that you are referring to Fabric World 770-413-7655.
There was a Discount Fabric in the Atlanta area (maybe 3?), but have closed.
(This is based totally on internet searches. I have no direct knowledge about this.)
bkay