Let it go. I've made a number of quilts for my grandkids. They drag them around and love that grandma made them. Wait until the baby is old enough to associate you with the quilt and to drag it around. Most people, not involved in quilting, think we just sew these up in one night.