Daniel Kokotajlo

a superintelligence.

This is an interesting rabbit hole, so let's stick with it, actually, before we get back to the intelligence explosion.

I actually don't know if... I think we're treating this really like all these technologies come out of this 1% of the economy that is research.

And right now, there's like a million superstar researchers, and instead of that, we'll have the superintelligence is doing that.

And my model is much more...

you know, Nukem and Watt were just like fucking around.

They didn't have this like, it's just like in human history, there's no clear examples of people being like, here's the roadmap and then we're going to work backwards from that to design the steam engine because this unlocks the industrial revolution.

A quick word from our sponsor, Scale AI.

Publicly available data is running out.

So major labs like Meta and Google DeepMind and OpenAI all partner with Scale to push the boundaries of what's possible.

Through Scale's data foundry, major labs get access to high-quality data to fuel post-training, including advanced reasoning capabilities.

As AI races forward, we must also strengthen human sovereignty.

SCALE's research team, SEAL, provides practical AI safety frameworks, evaluates frontier AI system safety via public leaderboards, and creates foundations for integrating advanced AI into society.

Most recently, in collaboration with the Center for AI Safety, SCALE published Humanity's Last Exam, a groundbreaking new AI benchmark for evaluating AI systems' expert level, knowledge, and reasoning across a wide range of fields.

If you're an AI researcher or engineer and you want to learn more about how Scale's data foundry and research team can help you go beyond the current frontier of capabilities, go to scale.com slash Dwarkesh.

Scott, I'm curious about, you know, you've reviewed Joseph Henrich's book, Secrets of Our Success, and then I interviewed him recently.

And there the perspective is very much like,

I don't know if you'd endorse, but, like, AGI is not even a thing almost.

I know I'm being a little trollish here, but it's just, like, you get out there, you and your ancestors try for a thousand years to make sense of what's happening in the environment, and some smart European coming around.

He can, like, literally be surrounded by plenty, and you just, like, will starve to death because...