I think it makes the total assembly go better if each component is the size and shape it's supposed to be.
If my big block has HST's in it - I tidy them up before going on
If my big block has a Diamond in a Square in it - I tidy that up before going on.
Usually, my units are pretty close to what I'm expecting them to be, but it's still worth my while to tidy them up.