I don't know if this is considered an herb, but I grow something a lot of people have never hearde of.
It's perennail (here in zone 5) and it tastes like celery. I use it like celery in cooking, but doubt it could be used where one uses fresh celery
Lovage - It grows to about 3 fett high