I don't have a cat but I do have a dog and he's trained as to what rooms in the house he is allowed in and which he is not. He knows not to enter my bedroom nor my art/sewing room. Surely cats can be trained to do the same thing.
I guess it boils down to "who is in charge" of you and your house; you or your cat.