I'm about 40 minutes from New Bern. There is a quilt shop/fabric store right in New Bern. There are wonderful shops in Jacksonville, about 30 minutes from New Bern, and there are quilt shops in Morehead City. I believe that there are guilds in all three locations. And, there is absolutely nothing in Greenville, so don't bother.....trust me on that one.
New Bern is a very nice small town and I'm sure you'll like it there.