My mother made many pot holders in her lifetime. She never used anything special. She sometimes just used old towels for the batting as they are cushy and you can put an extra thickness if they seem a bit thin.
I am very shy about getting my hands burned and always pick up two potholders for each hand, especially when the casserole dishes are glass.