"But the truth is not everyone deserves that patience."