I don't see why not, a bunch of different fabric/colors would look cool, but seams are a little "lumpy" for lack of a better word! When crocheting, it is like going over a speed bump!
That is why I always cut the total length of fabric...
Let me know if you decide to do!!
I am working on one that the material was 50cents on red tag sale at JoAnns right now...bunch of yucky flowers, but colors are wonderful and it is turning out nice!
good luck!