This is just my impression, but I've seen it happen, but if you're not careful you'll lose the quilters that want to learn and participate because of the ladies who want to come and chat with each other about non quilting subjects.
I would make a motion to raise the dues to 15.00 a month so that you can afford some good teachers and have some good programs. In the mean time, the other suggestions are terrific ones to keep the quilters going. You may find that the non quilters may move on, but it's better that way than losing your ladies who want to quilt.