"And I never get to spend time with him."