The very best oven mitts I have are store bought and use a very heavy layer of terry, plus canvas on the back. They are from Williams Sonoma.
If I was making oven mitts or hot pads I would use at least one layer of terry towelling (I would just cut up an old towel), with what ever other batting I might use.