The very first quilt I ever made was a crumb pieced top (although I didn't know that's what it was called at the time) with a terry cloth backing. No batting. I didn't have any problems with the terry cloth stretching. This was a drag around blanket for my youngest and I was just winging it. In fact, I think the DD still has that little quilt and it's probably 30+ years old.