Eliezer Yudkowsky

The thing you would do at this point if there were massive public outcry pointed in the right direction, which I do not expect, is shut down the GPU clusters and crash program on augmenting human intelligence biologically, not biologically.

Because if you make humans much smarter, they can actually be smart and nice.

You get that in a plausible way, in a way that it is not as easy to do with synthesizing these things from scratch, predicting the next tokens, and applying RLHF.

Humans start out in the frame that produces niceness, that has ever produced niceness.

And in saying this, I do not want to sound like the moral of this whole thing was like, oh, you need to engage in mass action and then everything will be all right.

Because there's so many things where somebody tells you that the world is ending and you need to recycle.

And if everybody does their part and recycles their cardboard, then we can all live happily ever after.

And this is not...

This is unfortunately not what I have to say.

Everybody recycling their cardboard is not going to fix this.

Everybody recycles their cardboard and then everybody ends up dead, metaphorically speaking.

But if there was enough on the margins, you just end up dead a little later on most of the things you can do that a few people can do by trying hard.

But if there was enough public outcry to shut down the GPU clusters, then you could be part of that outcry.

If Eliezer is wrong in the direction that Lex Fridman predicts, that there is enough public outcry pointed enough in the right direction to do something that actually results in people living...

Not just like we did something, not just there was an outcry and the outcry was like given form and something that was like safe and convenient and like didn't really inconvenience anybody and then everybody died everywhere.

There was enough actual like, oh, we're going to die.

We should not do that.

We should do something else, which is not that even if it is like not super duper convenient and wasn't inside the previous political Overton window.

If there is that kind of public, if I'm wrong and there is that kind of public outcry, then somebody in high school could be ready to be part of that.

If I'm wrong in other ways, then you could better be part of that.