Another reason why a soft yellow might work is because there is yellow in both the peach and green. Or it would be three neighboring colors on a color wheel - orange, yellow, green.
I can kind of see the floral being used as a sashing with the white in the blocks - the blocks do look clean and crisp - but I agree with you - they don't seem quite right with that floral.