For myself as long as they're all the same size I'm generally okay with it unless it's a real fussy block. For swaps I make sure my own blocks are the perfect measurement for the swap. I discovered I don't have much tolerance for other people's tolerance so I don't swap.