"I was so close to punching him back."