What kind of backing did you use? Was it so thin you could see through it or nice and strong? Not sheeting at a guess, thin muslin?
Otherwise, it must be the batting for it to come up through the stitching holes.
----
Oh, just re-read your letter. You said the "Whole" thing was covered with lint. Batting, batting, batting.