Not sure if the fuzzies of which you speak are?? ...
... the "balls" that sometimes form on flannels with washing? ... if so, it's just the way some flannels go, and there is not a lot one can do about it.
or ... the lint from the chenille attaching itself to the backside? ... if so, perhaps a good brushing with a lint brush or lint roller?