"We can't afford any more shake-ups in the campaign right now,"