"We should be spending time with him."