Good question! The term can be used that way, but not necessarily:

http://en.wikipedia.org/wiki/Linen