"Look, you didn't say yes or no."