"on a black minister, you'll lose the rank and file."