Alaskasunshine, if you sew them first, and then wash, won't some of the sweater material shrink differently, and more than the thread? I don't know much about felting, but you have me curious on this method...
I think I would be tempted to join the fabrics with a more dense decorative stitch, too. I too, would think that the seams would be pretty bulky.