I vote for the gray. While the white indeed makes the yellow fabrics pop, the gray seems to become a soothing element which allows the yellows to speak rather than shout. If you think too much gray might be a problem, then use white corner blocks to break up the horizontal and vertical lines. After that, use a narrow white border and a wider gray border to frame your finished masterpiece.