"He should be with his grandfather,"