I would machine stitch it if you can maneuver the non quilted cushion cover in your machine. Because it will be used to sit on or lean against, the sturdier the stitching, the fewer number of times you will need to repair any tears from normal wear.
I generally save my hand stitching for those things I can't get my machine to stitch.