If you can ease the blocks together and the result lays flat then you shouldn't have any problems. I did not start squaring up my blocks until well after my first few quilts were done. I do square up blocks and the quilt. In your case, it sounds like even squaring up the quilt would lose some points. Simply start by measuring the quilt top. Sometimes we surprise ourselves and things just fall into place.