When you do your yard sale/thrift store browsing, look for a good, comfortable, well-padded secretary's chair (the kind without arms).
Be sure to try it out before you buy, as some "fit" and others don't.
I got one a few years ago that was almost new for only $10! Before that I was using a dining room chair and it was just not the right height even with a cushion.