I guess none of us can really appreciate the passion someone has for something we just really aren't into or couldn't imagine wanting to be into. If someone were to ask me about quilting but didn't seem interested in any more than a short explanation of why I do it or what I'm making, I try to think (fast) what THEY might appreciate about it. The art? The math? The perseverence? The giving of time to a person in need via a charity? The patriotism. Anything to make a connection of their desire to mine is worth a try.
If I can't think of anything that they be remotely interest, if they're just making small talk, I keep it short . "Quilting is relaxing and mentally stimulating at the same time." I figure who doesn't like to relax? And if they don't like mental stimulation, I am not interested in holding a conversation with them ,either, so it's a win-win!