I have two kinds of trouble with colors. As my eyes age it is so much harder to see dark colors when on top of each other for piecing. Seeing the edges lined up is troublesome, not impossible but time consuming to double check my work.
In another sense, I am not drawn to pure primary colors, red, yellow and blue. I find them harsh and agitating rather than soft and soothing which is what I like my quilts to be. I have very little in my stash and that is fine. If these are the only colors in the crayon box I don't ever use, that's okay.