Are your quilts densely quilted? I love Warm & Natural, and use it almost exclusively in my quilts (well, I have the LA use it, lol). The batting needs to be able to trap pockets of air in it.
DH, who seems to always be cold, does want a down comforter on the bed in winter. Or we layer quilts.
Tonight, it might be both - it's 11 below right now!