Where we are we have no permit requirements either; last year we did the garage since that is the most important item, then started on the temporary living quarters that is attached to the garage as well. The only inspection we had was the county assessor come up to measure the garage for tax purposes.
It is the one thing I do like about living in the boonies, but the downside to that is the buildings that should be condemned are not and it makes for a eyesore.