You said you quilted the blocks first. This could be where your problem started.
Did you start in the center of the quilt, and SID outwards to all of the sides first? Stitching out a "grid work" first, helps to stabilize the whole quilt sandwich. Then go back and stitch inside of the individual blocks. :D:D:D