I agree, your basting is the problem. I can hand quilt but seldom enjoy doing it but I don't use a hoop. Basting is important to keep the three layer together where they belong, thus the reason why a frame is helpful. If you don't use a frame, the basting become more imperative to keep the layers together just the same way as in machine quilting. You don't want the layers to have an opportunity to shift.