I pin vertically too and about an inch from the edge so I can just keep sewing.
Works really well specially if your fabric is well starched. If I'm matching seams
I stick a pin where the seam should meet and then put another pin vertically
and remove that first pin.