"it wasn't just about the blacks."