I always spray the back side of fabrics, to me starch is just as important tool as my sewing machine.
The last can I got says on the front no residue and they are telling the truth.
Those white specks are just cornstarch and will wash off or wear off.