Since the quilt (so far) isn't symmetrical, it really doesn't matter which side you add to ... just stay with the flow. Part of the beauty of a bargello is that there doesn't have to be a top and a bottom edge.
FWIW, I've made at least five bargello quilts, and I think yours is absolutely GORGEOUS.