"You know, I think he got up there, and he was enamored by the big house"