"You're hurting your party."