This happens to me sometimes, not only with fabric, but with my keys, a recipe, a pair of shoes, etc. A very good friend told me once when this happens to her, she goes to the kitchen, makes a cup of tea, and spends five minutes in prayer. She told me this never failed her. I have had great success with it myself, however, my faith is not as great as hers, so I still sometimes am in my panic when I go back to look.