Maybe make it a wallhanging? It wouldn't get washed as often.
Or, go over the coloring several times to make it darker to begin with, intending for it to get softer with the washings?
You can also use watercolor colored pencils, and use textile medium to blend them. This makes the color permanent, and if you go lightly with the medium, keeps the fabric softer too.