I rarely wear perfumes and I tend to use scent-neutral items (soaps, deoderant, etc). As a result I can really tell when someone is wearing perfume.
For me, it's bad because I can tell when that person goes by my work desk, how long it's been since they've been in the room, etc.