"If you're asking whether I'll regret leaving Downton..."