"There will be a backlash if people don't stop"