"We just didn't quite fall in, not in the way he'd have liked."