There are two nice quilt shops right in Mt. Vernon. One is Aunt Bee's Quilts right on Main St. downtown. I can't remember the name of the other one right now, but maybe someone else will be able to come up with it. They are only a mile or two apart.
Another really nice one is Country Fabrics in Shiloh, just north of Mansfield.
The Calico Cupboard is in Pataskala, just to your southwest.
The Amish area, just east of you is full of wonderful quilt shops.