"They are using my success against me."