"Because it was them that was trying to get the North to secede again."