"Look, Gordon, I thought you would have realised"