Thanks everyone. Interesting answers here. I guess it's a matter of personal choice for everyone.
The reason I asked is because the fabric came from a house that hasn't been aired out in months and the fabrics had been stored for a long time, they smell musty.
I've only washed a few of the pieces. Think the rest will be washed without the softener.