Just about every single panel is THAT way. I have done what you say and once the entire quilt is done---it is not very noticeable. We notice things because we are quilters and super picky about our own work.
I have also put a border around the panel and then square it up. Will see if I can find an example of that.