"And the border states would have gone over"