"It was like letting the Von Bulows babysit."