You quilt is wonderful, his opinion is just that, an opinion. and you know what they say about those.
Grumpy old jerk is the typical "misery loves company" and he wanted to feel as low as he did.
Next time ask to see his handmade quilt. when he says he cant do it or whatever, just say . ya i thought so and ignore him