I am a border person, I think that it frames the quilt. That being said, don't let the quilt police stop you from doing what you like.
If it is only because you are not having enough backing, you might regret not doing the extra work of adding to the backing. I have been known to take things apart because i was not satisfied with the outcome.