Sometimes the fibers will contract just in response to the moisture. Many times I've taken a piece of (unwashed) fabric over to the ironing board, sprayed it with water, and just stood there and watched it contract.
I've read that the type of detergent used, and even the water quality (soft vs. hard) can affect the amount of shrinkage.