Daniel Kokotajlo

So I didn't make that much progress at this, but it's clear that there's some deep structure to this puzzle that would actually be really fun to try to unravel.

If you want to take a crack at it, go to janestreet.com slash Dwarkesh.

And if you enjoy puzzles like this, they're always recruiting.

Yep.

Thanks, Adam.

Yeah, thanks, Dwarkesh.

Take care.

The other notable thing about your model is, so you've got this superhuman thing at the end of it, and then it seems to just go through the tech tree of mirror life and nanobots and whatever crazy stuff.

And maybe that part I'm also really skeptical of.

It just looks like, if you look at the history of invention, it just seems like...

People are just trying different random stuff.

Often even before the theories about how that industry works or how the relevant machinery works is developed, like the steam engine was developed before the theory of thermodynamics.

The Wright brothers were just experimenting with airplanes.

And it's often influenced by breakthroughs in totally different fields, which is why you have this pattern of parallel innovation because the background level of tech is at a point at which you can do this experiment.

I mean, machine learning itself is...

a place where this happened, right?

Where people had these ideas about how to do deep learning or something, but it just took a totally unrelated industry of gaming to make the relevant progress to get the whole... Basically, the economy as a whole advanced enough that deep learning, like Jeffrey Hinton's ideas, could work.

So...

I know we're accelerating way into the future here, but I just want to get to this crux.

Yeah, I think the fact that there's a million of them