Don't store fabric with starch on it and you won't have the problem! One more reason NOT to have a stash! :)
Here is a little bit of info.
Habitat, Food Source(s): Silverfish are chewing insects and general feeders but prefer carbohydrates and protein, including flour, dried meat, rolled oats, paper and even glue. They and can survive long periods, sometimes over a year, without food but are sensitive to moisture and require a high humidity (75% to 90%) to survive. They also have a temperature preference between 70 and 80 degrees F. They are fast running and mostly active at night and generally prefer lower levels in homes, but may be found in attics.
http://insects.tamu.edu/fieldguide/aimg2.html
Most likely if you don't have problems with them in your home already they are not going to come in JUST for your starched fabric.