Eliezer Yudkowsky

And then that is hard and complicated.

And somebody in high school, I don't know, like you have presented a picture of the future that is not quite how I expected to go where there is public outcry.

And that outcry is put into a remotely useful direction, which I think at this point is just like shutting down the GPU clusters because no, we are not in a shape to like frantically do at the last minute, do decades worth of work.

The thing you would do at this point if there were massive public outcry pointed in the right direction, which I do not expect, is shut down the GPU clusters and crash program on augmenting human intelligence biologically, not biologically.

Because if you make humans much smarter, they can actually be smart and nice.

You get that in a plausible way, in a way that it is not as easy to do with synthesizing these things from scratch, predicting the next tokens, and applying RLHF.

Humans start out in the frame that produces niceness, that has ever produced niceness.

And in saying this, I do not want to sound like the moral of this whole thing was like, oh, you need to engage in mass action and then everything will be all right.

Because there's so many things where somebody tells you that the world is ending and you need to recycle.

And if everybody does their part and recycles their cardboard, then we can all live happily ever after.

And this is not...

This is unfortunately not what I have to say.

Everybody recycling their cardboard is not going to fix this.

Everybody recycles their cardboard and then everybody ends up dead, metaphorically speaking.

But if there was enough on the margins, you just end up dead a little later on most of the things you can do that a few people can do by trying hard.

But if there was enough public outcry to shut down the GPU clusters, then you could be part of that outcry.

If Eliezer is wrong in the direction that Lex Fridman predicts, that there is enough public outcry pointed enough in the right direction to do something that actually results in people living...

Not just like we did something, not just there was an outcry and the outcry was like given form and something that was like safe and convenient and like didn't really inconvenience anybody and then everybody died everywhere.

There was enough actual like, oh, we're going to die.

We should not do that.