Is the front cotton, flannel or a combination?
I think if you do it right and maybe frame the flannel in cotton, or frame cotton in flannel it would be fine. I'd think long and hard before I just willie/nillie put the two together. As long as it looks intentional - why not!