"The fact is, he started getting better after that."