"You're not really a conservative."