"I was always a little worried he was on to us."