"Listen, Robert... he can't go hit balls,"