I would check it out, what have you got to loose. If you could work do acctg part for awhile to see how they operate, treat their employees, benefits, etc. you'd have an easier time making a decision if you'd want to work there fulltime.
No need to feel guilty, it's not like you're being disloyal to your employer.