"If you don't want to be there for him, it's your decision."