I would only use all broadcloth as it is heavier than regular quilting cotton it would wear longer and better and hold the color better than regular quilting cotton. Same as I would not mix Poly blend fabrics with 100% Cotton fabrics. Poly blend wears longer and holds the color better.
It is your quilt and feel free to use whatever you like.