My mom is in a wheelchair and has a handicap tag. Whoever is with her gets to use the tag. (Mom never drove.) If there isn't a space we have to park somewhere else. One SIL loves taking mom places because she likes being able to park so close. Mom is amused. We always make sure mom has it back in the pocket of her wheelchair because we never know who will be available to take her places.
The one time I had trouble the handicap parking was on a fairly steep slope. It was close to the door but mom weighs 200 lbs and I couldn't help her and not worry about her chair rolling even with the brakes on. My car door kept wanting to close. So I moved further down where the lot was even. I've always wondered who planned that one.
I think if anyone ever has to help a handicapped person they would understand better why we need those spaces.