I do think all your colors go together, I think it is only the patterns on the fabrics some are questioning. I love scrappy quilts so perhaps am more tolerant of mixing patterns. I wouldn't hesitate to use your fabrics together.
I do agree that the pattern you finally decide on will have a lot to do with your final choices. I admire your willingness to try new things. Just don't be discouraged if it doesn't come easily at first. Try try again!!