Hi
I don't know where your house is, but around here (Texas) quilters and scrapbookers are willing to drive several hours to get to a retreat. Marketing and maintenance would be my two concerns.
There are two places near me (near being a couple hours drive) in Texas that may be good examples for you. Hobby House Hill was created for scrapbookers and has added quilting to their schedule. They are heavily booked.
http://hobbyhousehill.com/
Sunset Retreat is a newer one that started a few years ago and focuses on quilters. They have a small quilt shop onsite (quilters always forget something!). When they were getting ready to open they came to our quilt guild with quilt kits (fabric and patterns). Everyone who made a twin-size quilt for them received a coupon free weekend. It was a win-win since they got quilts for their beds, quilters learned of their retreats, and we got a free weekend!
http://sunsetretreat.com/
Maybe one or both of these could give you some inside information.
Again, marketing and maintenance would be my main concerns. I'm quite sure quilters would travel to your location if it was set up right.
Good luck with it.