I prefer poly for baby quilts. It washes and dries fast. You know what gets on baby quilts and they need to be washed very often. Don't take out the stitches, as it could cause some damage.
Warm is a good cotton batting, but I find it a little heavy for a tiny baby. Poly won't be as heavy on the little arms and legs though. Just keep going. You're doing fine.