Can't say I have ever encountered this problem. Is it 100% cotton? If so it sounds like it has thicker threads like cotton duck or canvas. Either one will get softer with washings and use eventually but I would worry about how comfortable it would be on a baby quilt. If you don't have any other options, I would just wash it a few more times and use it.