"If the governors desire my removal..."