"You weren't really next in line for the throne."