It really is easier to remove the offending piece from the block than you think. Just pick out the seams around it about one inch further than the piece is sized. You can even do this by machine. Just take your time, press the seams open so that they are not pushed to one side and are therefore easier to work with, replace the section, re-sew the seams a bit at a time.
Good luck!
Jan in VA