I woke up this morning thinking that the only thing I didn't try was laundry soap, so using an old washcloth with warm water, I poured laundry soap on the washcloth and rubbed it into the loveseat. It is now almost dried and I can see that for the most part, it worked! On the other loveseat I sprayed Shout! - hadn't thought of that either - and that also worked, but not as well, and the scent is a bit overwhelming, so I'll stick with my All.
To all: I have tried dish soap, upholstery cleaner, rug cleaner, Kids-n-Pets, baking soda and water, and shampoo.
To Chasing Hawk: everything is sewn together. It's almost like this giant suit was made, stuffed with foam and batting, then pulled tightly over a frame. The cushions are sewn together then sewn to the back of the sofa, the sides are sewn to the sides of the couch and the bottoms are sewn to the bottoms. It's crazy. I did take pictures but since I was able to clean them, I won't post. Thank you though.