I agree, leave it as is. I only see it because you pointed it out, with quilting it will never be noticed.
As a side note, I made a memory pillow for a friend and I ran out of the blue for one side panel, I thought the diagonal line where I added the additional piece stuck out like a sore thumb, but gave it to her anyway because she was going away and I wanted her to have it, anyway, when I gave it to her, all she talked about was "The wonderful arrow pointing right at her little angel." She thought the diagonal patch was an arrow. :-D My mistake actually made the pillow more wonderful in her eyes.