"I remember wishing we could take everyone with us."