Back in the day when I used to make my own clothes I found some fabric I absolutely loved. I bought it not knowing what I was going to do with it and eventually found a pattern for a two-piece dress that I made and it was one of my favorite outfits.
I agree with the others - life is too short to have regrets down the line, wishing you had purchased the fabric. Sometimes I just enjoy looking at my fabric!