"But it was only ever Rory."