I still prefer the white. So, if I were making it, I'd choose white and add red, navy and maybe some grays in some way. I love those colors. I seldom use yellow or orange unless it's in an I spy quilt. I'm not into browns, rusts, etc. Those are just my personal preferences.
However, I'm not making this quilt. I won't be living with it and looking at it every day. Do what pleases you. Take a photo so you can "step back" from it. If you still like the yellow, just do it.
This is for you, not us.
bkay