I've only done it the other way around (cotton top/flannel back) but what would be the difference? I used W&N but then I use that for everything. Can't see why you couldn't use any batting of your choice. Just wash your flannel as it will probably shrink quite a bit.