No you are not worried for nothing.. Do a test of some of the white fabric with a natural color behind it. I have found that with my quilts that have a white as dominant color in the quilt .. I use a white batting as the natural color of a batting does "shade" the white a bit .. it will depend on how tight its woven and how thick the fabric.