I make many baby quilts and I do not use flannel or fleece. Once a quilt is washed, it is soft and snugly. The batting is what makes a quilt warm, in my opinion. Have fun with the quilt. It is the joy of gifting a handmade quilt to honor a special little one. Do what feels best to you. You are creating life long memories for the child and his or her family.