Sometimes what works for me is to just "scratch" the fabric surface lightly with my finger nail, and it helps the threads shift a bit, to somewhat fill in the holes.
Keep in mind, that once you re-quilt it, it will be over what you have taken out, and chances are that will help to camouflage the holes that seem like craters to you right now!