I would do a couple test 4 patches.
I generally do not use batting in a rag quilt. I use flannel top middle and back or flannel top and denim back (or vis versa).
I have used three layers of flannel too.
Thinking about this a bit more, if you use fleece on the back it will be a magnet for the lint each and every time the finished quilt is washed.