Daniel Kokotajlo

It's like, what's the next step?

It's like...

Dude, that's a lot, yeah.

And we haven't really got into this because you're using the quote-unquote more conservative vision where it's not like godlike intelligence.

We're still using...

the conceptual handles we would have for humans.

But I probably do... I think I would rather have humans go back with their big picture understanding of what has happened over the last 2,000 years.

Like, me having seen everything rather than a super intelligence who knows nothing, but is just, like, in the Roman economy and they're, like, 1,000 next to this economy somehow.

Like, I think just knowing generally how things took off, knowing basically steam engine, dot, dot, dot, railroads, blah, blah, blah, is more valuable than...

a superintelligence.

This is an interesting rabbit hole, so let's stick with it, actually, before we get back to the intelligence explosion.

I actually don't know if... I think we're treating this really like all these technologies come out of this 1% of the economy that is research.

And right now, there's like a million superstar researchers, and instead of that, we'll have the superintelligence is doing that.

And my model is much more...

you know, Nukem and Watt were just like fucking around.

They didn't have this like, it's just like in human history, there's no clear examples of people being like, here's the roadmap and then we're going to work backwards from that to design the steam engine because this unlocks the industrial revolution.

A quick word from our sponsor, Scale AI.

Publicly available data is running out.

So major labs like Meta and Google DeepMind and OpenAI all partner with Scale to push the boundaries of what's possible.

Through Scale's data foundry, major labs get access to high-quality data to fuel post-training, including advanced reasoning capabilities.