I think it just depends. I was dating someone who wanted me to choose between him and quilting. He lost.
So in all subsequent relationships, I told the guy that if he asked me to choose, he would lose. And (while single) I bought a house that was big enough for all of my quilting stuff. So when a guy came into my life, the quilting was established. And I kept going until I found DH who is completely supportive of my habit (and can be an enabler - he drove me to Quilt in a Day and told me to take my time)