The pot holders I make only require one layer of insul-brite, but the cotton fabric on one side ends up being 4 layers thick because of the way it is folded.
The pattern I used was shared on this board a couple of years ago. I made a lot of potholders 2 years ago as Christmas gifts.