If you hadn't told us it was "wrong," I'd never have known. Since you did tell us, though, I tried to picture it in my mind the "right" way, and I do think it would look more balanced if you changed it. Bottom line is that it's your quilt - you should do what will make you feel best about the finished project. But unless you point it out, I don't think anyone will know the difference.