What about adding spacer blocks like half squares, flying geese, pinwheels, etc? Use a bit of graph paper and place your panels in a grouping and then you can see what fillers you need to add. It will give your eyes places to stop as you look at the panels.