If you enjoy doing the fabric swap - continue to do so.
You just "might" never get around to making a quilt from that pattern.
If you use the fabrics in something else - hey - they wanted to be there instead!
(It's nice of you to be concerned for the leader, though.)