No, it wouldn't.
The blocks are all squared to the correct block size which is also called unfinished size. If the other blocks "don't need trimming" that means they should be the correct size. If they are "under" size, I remake them.
All units should be made to the correct unit size. Then the finished block is checked and squared up.
Starting with the correct size will make borders easier too. Good luck!