I have an all male household and I do use white backgrounds (smile). I use whatever goes with the blocks and/or pattern that I am making. My males do fine with white backgrounds and you might be surprised how much they like them. Go for it. Otherwise choose a color that you really want to be pronounced in your quilt and create, create, create.