Is this a pattern that would allow putting strips on the 4-patches, then squaring up the blocks with the strips? Then the variance is not noticeable, unless maybe the quilt police look!
Otherwise, I would just put it together. Pressing well can help too. Believe it or not, if this is to use, most likely NO ONE will notice after it is quilted, esp. if you have not washed the fabrics first.......