I am not really clear on how you are hanging the fabric. Is the selvedge edge on the bottom? Or on the sides?
In any case, my best guess is that your sewing machine stitch is gathering the fabric ever so slightly as you hem. I believe one fix for this is to hold the hem firmly both in front of and behind the presser foot as you sew, making sure that the fabric is taut.