"Downton would have to be sold to pay for it. Is that what you want?"