1) the 4 patches are not ugly.
2) I like to alternate 4 patches with solid blocks; either yellow or blue will look good, and 'solid' does not necessarily mean 'plain solid color;' it can be a print that is predominately one hue or another.
3) I think it will look great no matter what you do.