"By the time I'm finished with him, he won't be speaker."