"I won't rekindle Lord Merton's dreams unless I'm invited to do so"