If your pieces of flannel aren't really tiny it should be fine to wash them, delicate cycle, hot water. Flannel shrinks and often bleeds as well, so I can't see anything good come out of not washing it. I wash small scraps all the time when I pick them up at the guild's free table. Some of them ravel, but I just clip off those threads.