It's just like anything else in a marriage - balance and compromise are key! Everyone can get what they want, you just need to work together to figure out what that is and how to get there.
I quilt in the living room with my husband. I'm planning to move my sewing all upstairs shortly, with part of the room being dedicated to my husband's musical instruments (he's a musician and music teacher) so he can practice while I quilt.
You'll work it out. :)