I don't pin my binding to initally sew it to the top, but I do glue baste the binding down before hand or machine sewing it to the other side.
Here is a tute I made for using Elmer's glue. It completely washes out of the quilt, won't stain or discolor, and you purchase a special tip and only use the smallest of drops of glue. the tips can be bought in most craft shops, they are made for acrylic paint, but work awesome for this method. Look where they sell the little bottles of applebarrel or similar brands...
http://www.quiltingboard.com/t-29275-1.htm