You need to sew with a SCANT quarter inch, which is about a thread width of your quarter inche seam.. this is because you lose about that much when you press to one side.
You are not doing anthing wrong, just move your seam line over a tiny bit and you will be right on..