I have mad several rag quilts combining fleece and flannel with good results.
The fleece (and minky) doesn't "rag" or unravel. But, you can (and do!) cut it along with the flannel and when you wash it, the edges still wrinkle up.
I say, go for it! I think it will be cute!
Be sure to post a picture when you are done! :)