For men, research suggests that sexual betrayal in a relationship is worse than emotional infidelity. For women, an emotional connection makes an affair more upsetting. After getting caught in an affair, South Carolina Gov. Mark Sanford proclaimed his mistress his "soul mate," prompting his wife to leave him. "Absolutely the wrong button, because what he implied was that he had this emotional relationship with her. And that's the thing that in general women find the worst," said Temple psychologist Frank Farley.