"You can't keep coming in and out of people's lives,"