Hi Michelle: My husband and I have been going to the southern Maine coast for years. Scenic, beautiful, always affordable (especially just a little off season). Great shopping, food, quilt stores. Probably 40-60 miles up the Maine Turnpike you can go to Freeport for the day and enjoy LL Bean and the other outlets. If you'd rather be in a city, Portland Maine offers a lot.
You asked about eastern NYS. The Lake George area in the Adirondack Mountains is lovely and probably not quite an hour from the VT boarder.
NH is beautiful, especially down by Lake Winapasake (sorry, I know my spelling is dead wrong), and there are several quilt shops including Keepsake Quilts in Center Harbor. The tiny strip of coastline known as Hampton Beach is a fun spot. Very 50-s retro appearing.
Any of the above just google and they will mail you a wonderful guide book.