Absolutely agree with you about Penneys. Used to shop there almost exclusively. Now they don't carry anything I want to buy. I do check their sales for kids clothes, but that's about it.
Crazy as it sounds, I've found tall sizes in Walmart when shopping for my 5'11' grand daughter. But they don't have the high waist you're looking for.