Dwarkesh

So for example, people used to think that AI would surely be truly intelligent if it solved chess, and then it solved chess, and you're like, no, that's just algorithms.

And then they said, well, maybe it would be truly intelligent if it could do philosophy, and then it could write philosophical discourses.

We were like, no, we just understand those are algorithms.

I think there's going to be, I think there already is something similar with like, is the AI misaligned?

Is the AI evil?

Where there's this kind of distant idea of some evil AI, but then whenever something goes wrong, people are just like, oh, that's the algorithm.

So for example, I think like 10 years ago,

You had asked, like, when will we know that misalignment is really an important thing to worry about?

People would say, oh, if the AI ever lies to you.

Of course, AIs lie to people all the time now, and everybody just kind of dismisses it because we understand why it happens.

It's a thing that would obviously happen based on our current AI architecture.

Or like five years ago, they might have said, well, if an AI threatens to kill someone.

I think Bing, like, threatened to kill a New York Times reporter during an interview.

And everyone's just like, oh, yeah, AIs are like that.

What does your shirt say?

And I mean, I don't disagree with this.

I'm also in this position.

I see the AI is lying and it's obviously just like an artifact of the training process.

It's not anything sinister.

But I think this is just going to keep happening where no matter what evidence we get, people are going to think, oh yeah, that's not the AI turns evil thing that people have worried about.