If your blocks are all squares, can you trim them all down to the same size? Maybe discard and remake, or unpick the very smallest one(s). You might loose points, but the assembly will be easier. As everyone else stated, it depends on how much off they are.