That has happened to me too. I had to find different fabric to finish my project because there was no way to make it straight of grain, and it really would show in the design. I was doing a 4th of July table runner and the flags that were going to go into the center blocks were so bad couldn't use them.. Thank goodness for an embroidery machine and fabric that blended so I could embroider something patriotic in the center blocks.
Good Luck
Suzy