Would the glitter fabric cause a problem with someone breathing in the glitter particles?
Maybe shake as much of the glitter off as you can before you bring the fabric inside.
I had that happen to me, too. I think I am still getting glitter off some things!