"I asked him to come and see me so we could have a frank conversation,"