I adjust the seam when it comes to the point. Sometimes it's a little bigger than 1/4" and sometimes it's a little less. I also go quite slow because there is generally a larger bump where the pieces come together and everything is pinned. The better the prep work is the better the blocks (points) will be.
Have you measured your pieces to see if you have a 1/4" to work with? A little analysis surely explains your issue and offers a solution.