"You can't go around punching people who are jerks."