What a wonderful idea and it will be a great treasure for the new baby. The only think I have to add is that you may want to apply fusible stabilizer once you take the seams apart on the sweater. It would be like the T-shirt quilt that are made. Good luck on your adventure.