Yes, you had it right, a used dryer sheet has enough chemicals left to do the job. We use them whenever we have stuck on things that need removing. We just use room temperature water. They work.
The dryer sheets are also good at removing the brown spots off baking ware and cleaning off the gunk that collects around sink spigots and cleaning the shower walls (not the glass, though).