i have machine stitched some bindings. i sew on the front, fold over to the back and i use straight pins to hold it in place. i put the pins in along the stitching line from the front, making sure to catch the binding on the back. once in awhile i miss a corner a bit but otherwise, it's been fine.
if i hand stitch, i use my metal binding clips to hold it in place.