Do you have an historically restored building/house near by?
A tour there with ladies' luncheon might go well. Possibly one where the ladies and gentlemen dress up in 1800s styles and have high tea.
Folks I know love to dress up for luncheons. I found a picture where I'd gone to a ladies' luncheon wearing my aunt's 1930s dress (I'm 76 so it is not new) and everyone had to wear a hat, bought, old or home made.
Or tour historical houses, should you have any nearby. I've gone on tours and seen some lovely restored ones. Had luncheon in Victorian styled cafes/restaurants.
With weather uncertain in fall, perhaps some farm is near enough to visit with big barns or somewhere like that to stay in during bad weather and clean/neat enough to eat and have crafts from local people, or simply made by the church folks.
Or a party where you dress up like the founders of your church might have dressed in their day and time.
A songfest with the best of local musicians who might belong to this church.