"BERT: Just needs a sprinkle of squirrel dung."