I personally would not mix other fabrics with flannel since flannel tends to shrink A LOT and the other fabrics may not shrink at the same rate it may distiort the shape . You could try wasing the flannel several times and drying to get all the sshrinkage out of it. What about just using cotton ?