What kind of handgun are you talking about....a revolver or a semi-automatic pistol? A .22 derringer or a full-sized military .45?
I always, always, always carry on my body instead of in a purse or pocket. It is a safety issue and a weapon retention issue. A purse snatcher can easily grab a purse and should never find a handgun in it as part of his reward! A properly designed holster protects the gun carrier and those around us from "accidental" (negligent) weapons discharges. Even if a gun in a hip holster were to fire, the round would travel down into the ground/floor. A leg or foot wound might result but it probably wouldn't be lethal. A properly designed holster can also make it more difficult for anyone but the wearer to draw the gun from the holster.