i used flannel instead of batting in a couple raggy quilts i made...
i think you need something (won't get much fray...ragginess) with only 2 layers of cotton...unless you make your seams really small and clip real close together so its more like corduroy instead of chenelle.
experiment with a couple small blocks to see how they come out and what you prefer.