I can't say for sure but I have had the same problem with a block before, it had a lot of different angle pieces within it and you couldn't 'square' it up as you went along due to the irregular shapes created prior to completing the block.
Is this the same problem? If not and you can square it up as you go, take the time and determine if a section measures, say 3" before proceeding to attach the next section.