I have boatloads downloaded, too.
I used to find them in magazines, and I'd turn down a page corner and keep the magazine. Every so often, I grab a stack of magazines and pour through them again and see if I go to turn down any of the same corners. If I'm not moved by any of them, the magazine goes, but often the same one or two will catch my attention – then I know the pattern/magazine is a keeper.
I probably need to do the same with the patterns I've downloaded...