Rory Stewart

So the biggest risk is from rogue states like North Korea, where they've got so little power that making crazy reckless threats can actually be quite powerful.

But look, there's going to have to be some huge bargaining over what are in those principles and what have exceptions for national security.

But just briefly, I think, yeah, on the software side, having this written document and then saying any frontier model has to be able to demonstrate that AI will behave in line with the specification, including in very unusual scenarios.

And that means you have to show that it hasn't been sabotaged, whether internally or via foreign interference, and the AI hasn't formed goals of itself.

So you know that it's going to generalize well.

Well, he was in the past.

Is he not anymore?

Not anymore.

But the thing that's weird, so I mean, yeah, I've written about long-termism, the importance of taking future generations seriously, looking very far ahead.

The thing that's just strange about the world now is that all these things I'm talking about, I'm thinking the next five years, as in very significant chance that we start on this takeoff of AIs building better AIs and this huge leap forward in technological ability in the next year or two even.

It's probably not, but maybe even then.

Absolutely not too late because the world still hasn't kind of woken up.

There is already a differential in terms of hard power from the US and other countries, but other countries do have some.

The Netherlands has ASML, which produces 100% the entire world production of, they're called extreme ultraviolet lithography machines.

And I would thoroughly recommend everyone to go and look into this.

There's a great Veritasium video on YouTube.

It's very fun.

It's the most sophisticated technology in the world, essentially.

It's one company, ASML, it's called.

Was the government involved?