"And as his career got better and better, he wanted to get out of it."