"You took the oath. You can't leave."