"You would think. If you were living in an all-white neighborhood"