"We knew hard times were coming for estates like Downton,"