Do you have it all basted and ready for quilting?
I would do the stitch in the ditch after I have it all pin basted in place, and then go to the hand quilting.
The basting is good, but the stitch in the ditch you will be doing will stabilize it even further ....
Then, you should be able to hand quilt to your heart's delight.