If you want it to look like it did originally, you'll need to pull that piece out. It's not that bad, really. I've handled a similar situation for someone else's quilt.
Take frequent deep breaths. Use a blind stitch to get the new piece in. Work with it flat. You'll be fine.
Otherwise, applique over it. If you use the same fabric, it won't be as noticable.