First of all, your quilt is absolutely beautiful, but this is obviously bothering you, or you wouldn't pose the question, so given that, I would take the border off and sew it the other way. Yes, it will take some time, but you will probably be happier with it if you do.