I'm still new at this. I started hand quilting 10-11 years ago. I love doing it in the winter, but not in the summer! I started machine quilting last year.
I spent about $20 to get started with hand-quilting. Thimble, needles, lap hoop... all from Joanns or WalMart. I've spent a LOT more money for a sewing machine that likes to machine quilt, quilting/darning foot, walking foot, etc. I got lucky and got a great big desk for free that I use for a sewing table, but they can be expensive too. And a machine on a frame? Cheapest I've seen is Craigslist for $750 for a 9-inch throat. I almost got a 24-inch machine for $1200 but that didn't work out.
One of these days, I'm going to rent the long-arm at my fabric store. You might want to try that and see if it's your cup of tea