My sister, the tailor and general sewer, feels the exact same way! "Only a quarter of an inch?!?"
Go forward in faith! It's not as hard as it appears at first. Besides, fudging with a larger seam allowance means your squares and corners will be less likely to match.
You will also use a lot less fabric.