I came here to say exactly what Lori S just said about calculating the value of any benefits you have at your present job. My other hobby is one where people often think, "I should quit my job and go fulltime!" But the few people I know who have made a success at it have worked hard to survive.
I'm not saying you can't do it, but you need to understand what you're getting into first.
Tate