"..but then that would've brought back too many memories of Daryl."