I was going to say pretty much the same thing that Irish did... your hubby's ex, and her children helped to make him the man he is today...and you love the man he is today.
If they weren't jealous of me, I'd most likely be able to be friends with both my hubby's exwife and exgirlfriend...~shrug~
I wish you peace in whatever decision you make... :)