Hmmm....looking at Barbara Black's quilt, her X's are all made from the same fabric and she carried that on by alternating each X block with a plain block. I like her layout because her X blocks really stand out and her quilt does not look at all busy. Using a single fabric for alternate blocks would definitely enlarge your quilt but personally, I would have difficulty choosing that fabric.