Welcome to NC!
I'm in Chapel Hill - Thimble Pleasures is my go to store.
Elizabeth City is way east of us. In a quick google search, I see a few possible candidates - Terris' Fashion Fabrics in Rocky Mount; All About Quilting in Jacksonville; New Bern Fabric Center in New Bern - but all of these are a bit of a drive. I haven't been to any of those. I do like Loving Stitches in Fayetteville and there are several great stores in the Raleigh area.
You are actually closer to the Hampton VA area - Fabric Hut in Norfolk, VA; Sara's Thimble and Sew E-Z in Virginia Beach.
I agree that the Mid Atlantic Quilt Festival in Hampton (end of February) is worth the trip. NC Quilt Symposium is also a great experience and draws quilters from all over the state (generally the end of May).
Cheers, K