Max Tegmark

But we have to also stop at some point, right?

Quit while we're ahead.

It's a suicide race.

It cannot be won.

But the way to really benefit from it is...

Continue developing awesome AI, a little bit slower, so we make it safe, make sure it does the things that humans want, and create a condition where everybody wins.

Technology has shown us that geopolitics and politics in general is not a zero-sum game at all.

If it's created very, very soon and is a big black box that we don't understand, like the large language models, yeah, then I'm very confident they're going to lose control.

But this isn't just me saying it.

Sam Altman and Demis Hassabis have both said...

acknowledge that there's really great risks with this and they want to slow down once they feel it gets scary.

But it's clear that they're stuck in this.

Again, Moloch is forcing them to go a little faster than they're comfortable with because of pressure from just commercial pressures, right?

To get a bit optimistic here, of course, this is a problem that can be ultimately solved.

It just, to win this wisdom race,

It's clear that what we hoped that was going to happen hasn't happened.

The capability progress has gone faster than a lot of people thought, and the progress in the public sphere of policymaking and so on has gone slower than we thought.

Even the technical AI safety has gone slower.

A lot of the technical safety research was kind of banking on that...

large language models and other poorly understood systems couldn't get us all the way that you had to build more of a kind of intelligence that you could understand maybe it could prove itself safe you know things like this and um