I use washed and unwashed fabric all the time in quilts and never have a problem. Once they are sewn together and quilted everything is fine.
The crinkled look after washing comes from the cotton batting shrinking and not the fabric. If you don't like that look use a different batting.