Fifee, you're probably the only one who will ever notice the speckles.
nativetexan, if you don't see or feel any difference, your batting probably doesn't have a rough side. I don't see a difference in any of my Quilter's Dream batts, or Hobbs 80/20. Battings on which I have noticed a bumpy side are Warm & Natural, Warm & White, Hobbs 100% Cotton, and Quilter's 80/20 by Fairfield.