Have you used starch on your fabric? You might be sensitive to it. Sometimes the palms of our hands are much tougher than the rest of our skin, so it might only be bothering you as you slide across and not when you just touch it.
When one of my boys was born, the laundry at the hospital mistakenly put starch on the pillowcases they used as sheets in the newborn nursery. All the babies ended up with a red rash wherever their skin touched the starched fabric. Created all sorts of panic in the hospital!