I normally use flannel in the middle, but have used warm & natural batting. When I use the batting, I cut an inch smaller, but do the X, so that keeps it from bunching. When I use flannel, I cut the same size.
I really think the X stops the bunching.
Good Luck!