Dwarkesh

But we discuss all of these very technical questions about the nature of superintelligence, and we barely even begin to speculate about what happens in society just because with superintelligence you can at least draw a line through the benchmarks and try to extrapolate.

And here, not only is society inherently chaotic, but there are so many things that we could be leaving out.

If we can enhance IQ, that's one thing.

If we can consult the superintelligent oracle,

That's another.

There have been several war games that hinge on, oh, we just invented perfect lie detectors.

Now all of our treaties are messed up.

So there's so much stuff like that, that even though we're doing this incredibly speculative thing that ends with a crazy sci-fi scenario, I still feel really reluctant to speculate.

I am also worried about UBI from a different perspective.

Like I think, again, in this world where everything goes perfectly and we have limitless prosperity, I think that just the default of limitless prosperity is that people do mindless consumerism.

I think there's going to be some incredible video games after super intelligent AI.

And I think that there's going to need to be some way to push back against that.

Again, we're classical liberals.

My...

My dream way of pushing back against that is kind of giving people the tools to push back against it themselves, seeing what they come up with.

I mean, maybe some people will become like the Amish, try to only live with a certain subset of these super technologies.

I do think that somebody who is less invested in that than I am could say, okay, fine, 1% of people are really agentic, try to do that.

The other 99% do fall into mindless consumerist slop.

What are we going to do as a society to prevent that?

And there my answer is just, I don't know, let's ask the super intelligent AI oracle.