"You and I both know that he would have spent most of that time"