Hmmm can you post a picture?
Personally.... if these are piecing stitches and not quilting stitches, if the stitches don't show, if the block is absolutely secure and in no danger of coming apart... I'd be tempted to leave it.
Do you need help troubleshooting and fixing your tension issues?