When my husband and I started our business, we used an accountant to set up QuickBooks. Now all I have to do is input the information, and hand off the files to the accountant at tax time.
In Albany, I would check with the Albany/Colonie Regional Chamber of Commerce and see what information they have available. I know our county has a program just for small business development (I'm just south of Albany). They review setting up a business plan, marketing, and probably accounting, too.
Good luck - owning a business is a lot of hard work, and a lot of fun sometimes, too.