"because I'm his doctor, not his family."