I always rip from the bottom unless it's such a tangled mess I can't get at the stitches. I get bigger pieces of thread that way instead of the little tiny bits. I'm not sure I'd use duct tape -- it is very sticky to catch the treads yes.. but I'd be afraid it would leave some sticky on the fabric, and duct tape sticky is nasty to try and get off.