"He needs to go away, quietly."