I would do as mommamac said and finish it kinda wonkified.....
Here is a picture of a log cabin with fussy cut centers that I made a while back. I just started making the blocks and when they looked good to me I stopped sewing, some of them were the correct size some were not I took the white fabric and sashed the ones that needed a "little extra" and didn't put anything around the ones that were the right size, I then put a block that needed extra next to a block that didn't kinda to make look like everything had been "sashed". You can even set them kinda "funky" if you wanted to whien your squaring them up.