"If you march all the way back north now, you'll lose what you gained."