The instructions could have been written much better I think. It seems odd I know, but the handles and button loop need to be down when the layers are stitched together.
(On the outside of the outer side of the bag, in other words)...
Hope this helps..