"You know, it was a joke, but it was not a funny joke."