Yes, it's very frustrating, whether you hear well or not.
It seems rare to talk to a human anymore.
I sometimes have a terrible time with accents. When I keep asking them to repeat some people get mad. I don't mean to anger them but I can't help it if I don't understand!
My Mom has an awful time with her hearing and I can understand her frustration :(
I get messages on my phone that take repeated listening to understand. You are not alone!