I use a seam ripper, but I slip the point under the top thread every 1.5 to 2", tip the point away from the fabric slightly, then apply light pressure to clip the thread. Then, like you, I pull the bottom thread out of the fabric.
No doubt it's still possible to slip and cut the fabric, but haven't slipped since I figured out this method after a disastrous slip.