"He's going to know who voted against him."