Just the fact that the thought entered your mind to keep it means it is calling to you. I did the same when we were dividing my grandmother's quilts. There was a scrap ocean wave that I remember almost every fabric being someone's garment. I kept it.