I had this problem with panels that I wanted to fracture. As I do all of my fabric ... I pre-washed the panels. I'm betting they were wonky before I started, but oh boy washing made them worse!!
I blocked them, but in the end I couldn't get the entire panel squared up and ended up cutting it down to a size that I could get blocked.
You can try blocking them, it did improve mine.