If you decide you don't want to go for the interesting texture variation of the shirts and sweaters I would suggest corduroy as a possible additional fabric to use with the sweaters. It also lends itself nicely to the larger 6"-8" squares you would want to use for the sweaters.