Sam Altman

People want drama.

People want new things.

People want to create.

People want to, like, feel useful.

People want to do all these things, and we're just going to find new and different ways to do them, even in a vastly better, like, unimaginably good standard of living world.

So first of all, I will say, I think that

There's some chance of that.

And it's really important to acknowledge it because if we don't talk about it, if we don't treat it as potentially real, we won't put enough effort into solving it.

And I think we do have to discover new techniques to be able to solve it.

I think a lot of the predictions, this is true for any new field, but a lot of the predictions about AI in terms of capabilities, in terms of what the safety challenges and the easy parts are going to be, have turned out to be wrong.

The only way I know how to solve a problem like this is iterating our way through it, learning early, and limiting the number of one-shot-to-get-it-right scenarios that we have.

Well, I can't just pick one AI safety case or AI alignment case, but I think Eliezer wrote a really great blog post.

I think some of his work has been somewhat difficult to follow or had what I view as quite significant logical flaws.

But he wrote this one blog post outlining why he believed that alignment was such a hard problem that I thought was...

Again, don't agree with a lot of it, but well-reasoned and thoughtful and very worth reading.

So I think I'd point people to that as the steel man.

A lot of the formative AI safety work was done before people even believed in deep learning.

And certainly before people believed in large language models.

And I don't think it's updated enough given everything we've learned now and everything we will learn going forward.

So I think it's got to be this...