"I mean, I think it would be wise if we spent father-son time"