As the others have said, only you can tell if it's going to annoy you. What I do now is carry on with the rest of the project and if the offending piece is still bothering me when it's time to put it together, I redo it.
Just recently I cut the wrong size of fabric on one small piece of a BOM and had to join pieces together. To redo it would have been a little pricey as well as a car journey, so I carried on and from even a foot away, you couldn't see the join, so I left it.
Another time I reversed 5 or more 2 1/2" squares on a twister quilt and noticed just before I started to cut them with the little square ruler. A royal pain unsewing, but couldn't bear to leave it as it was.