You probably can delete an abandoned site - if it's yours - and if you care to take the time to do so.
But... since a lot of sites have ads on them, and the site owner can earn a bit of revenue when people click on those ads, there's actually an incentive to just leave the site up and running, abandoned or not.