I would stay away from fleece and wool....and go with just a nice weight flannel for 'something' in the middle....
make sure however that you really really wash it as it will shrink, shrink and shrink.....
The end product should be lovely with only a minimal weight to it but something to quilt to.....