Forgive me if I am completely off base but it seems as though you might put that unwanted border around the too small block and then put a very few more unwanted boarders around another few blocks that you knowingly made too small and then artistically disburse the boardered blocks in the quilt. I am suggesting blind because I do not know what you have in mind for the finished quilt.
My favorite things are those that show the creation and humanity of the maker, not absolute cookie cutter precision. Touching something unique let's me touch the mind AND heart of its maker.
Please let us see what you decide. We are all rooting for you.
P