"Making each of us feel it's our fault he couldn't leave the other woman."