"Once, I thought my daughter Charlotte might have cheered him up."