I only wash fabrics if I am in a swap that asks that the fabric be pre-washed. Otherwise, I just use it straight from the store. Haven't had an issue yet.
Although, I have washed some hand-dyed fabric to make sure the excess dye was washed out first.