I have mixed pre-washed and non washed fabric in a quilt with no problems. The quilting I think really helps stabilize things together.
I would air your fabrics outside even though you've washed them. There's nothing like fresh air to get out smells. I've had some really musty, smelly fabric that I've gotten from people and that's done the trick every time.