"I was scared of the influence you were having on Sam."