I don't think so. From what I read, the fabric needs to be "glued" to the wall like wallpaper is. Flannel that is straight up and down might not hold pieces very well -- especially blocks and strips; usually you want to be able to pin into a design wall just in case. I wouldn't want to try to put pins into a wall.
Also, I can't help thinking how fast flannel would capture dust and pet hair.