"But I assure you, nothing inappropriate happened between me and your wife."