No clue if this will help, but I have an out-of-square quilt in my hand quilting frame. I put a few pieces of batting in the quilt roll on the longer side of the misshapen quilt to take up the slack. I'm sure I've committed an unpardonable sin, but it made it easier to work with.