I have had the same thing happen to me, my husbands taste and mine are very different, I call him Mr Dull, all of his clothes match each other. So I have tried to tell myself his opinoin won't count on this matter, but then he says something, and it will seem to ruin the whole project for me.
I wish I had some wisdom to impart, I am just as prone to this problem as you are!