"we've got to sit him down with the whole family,"