Any free or paid pattern that you have in your library will still be there, even if the pattern was purged from the site.
The only way you will lose a pattern is if the author "updates" it, and replaces the pattern with a document pointing you to their website or something. I lost a couple patterns I had paid for this way, and I'm really upset with the pattern author, but that's her fault, not Craftsy's.