"But I still don't feel right about leaving the little ones."