"One punch from him would knock one of us out."