The IRS calls are usually from south Asia; the Publishers Clearing House calls are from the Caribbean, and of course the "trunk box waiting at the airport" are usually from Africa.
As to the saying "yes" scam, I don't believe there's ever been a case of anyone losing money because of that.