I would disagree that machines are expensive. Sure, new ones with manuals and that do all sorts of things can be expensive, especially if you want one that lasts too.
As someone who has had both high end and simple vintage machines, all you need for quilting is a good solid straight stitch. That might not be all you want, but it is all you need.
There are plenty of solid little working machines out there in thrift stores and garage sales and such that are being given as free or sold close to it. With the internet you can get a manual or advice from sites like this one. You can do your own maintenance with a simple machine, they really aren't that complicated.
I am aware that my thrift store shopping here in Seattle is like the Mecca of the thrift world -- we have so much good stuff go through the stores and the sorts of goodies I find are just not in all areas. But also look for actual fabric in addition to sheets. You will notice that most modern patterns are built/designed around buying/using large amounts of yardage. But budget quilting is scrap quilting and some designs are more friendly to that than others. And that brings up the problem of storage, it may actually be a better deal to just buy the fabric you want when you want it/can afford it than try to put together things you find.
New quilters also should be told that fabric changes. All the time and there are no guarantees that the fabric you like today will be available tomorrow, much less 3 years from now.
I started quilting quite young, I think the best advice I could have been given was to not be intimidated by the little old quilt ladies. Now that I've become one myself, I find we quilters in general are some of the best people
And we often have excess fabric of our own and sometimes even machines and stuff...