We feel your pain. Many of us 'have been there and done that'. Chocolate, wine and time away will help
I also agree that the problem could be your 1/4" seam. Thread and pressing can also effect your blocks size.
I have tape on my machine that I have marked 1/4 seam. Since I have done that, 95% of the time my block are spot on.
Good luck