Tell me about it, and lived through the experience too.
If in a block swap, then by all means my 1/4 seam is relevant to the pattern directions, but for my projects now, I am using a tad bigger than the 1/4" seam to avoid ripped seams.
IMHO; It's better to make the seams a tad bigger just in case.