What about just adding sashing between the rows... if you put the blocks in order from smallest to largest... then add sashing that is a little wider around some, and not so wide around others. As long as the biggest block isn't next to the smallest, it wouldn't be noticeable.