You need to use whatever size 1/4 or scant 1/4 so that the individual units of your block (4 patch etc)measure the correct size during construction so the whole block comes together accurately. The only time I worry about seam allowances is when a block has to end up a certain size for a block exchange. For my own sewing being consistent with the seam allowance is accurate enough.