"I'm going down in history as the mayor who let New York"