"But I thought, and I thought that I don't like the direction our party is taking."