"I'd sit at the counter and watch him, both of us just silent."