Many years ago, I was making a two- layer fleece blanket. For some reason, I had to wash it. I learned then that fleece did not shrink evenly. I had to completrely unsee it and redo it , so it would lay flat.
So my suggestion is to wash the fleecr pieces before sewing them