"Big old place like that, rumours get started."