Dwarkesh Patel

He tried, I think, he told me a bunch of things, like supervised fine-tuning and retrieval, whatever.

And he just could not get them to make cards to a satisfaction.

So I find it striking that even in language out domains, it's actually very hard to get a lot of economic value out of these models separate from coding.

And I don't know what explains it.

How do you think about superintelligence?

Do you expect it to feel qualitatively different from normal humans or human companies?

roughly speaking.

I guess automation includes the things humans can already do and super intelligence supplies things to humans.

Yeah.

But I guess maybe less abstractly and more sort of like qualitatively, do you expect something to feel like, okay, because this thing can either think so fast or has so many copies or the copies can merge back in themselves or is quote unquote much smarter, any number of advantages an AI might have.

It will qualitatively, the civilization in which these AIs exist will just feel qualitatively different from human civilization.

Let me probe on that a bit.

It's not clear to me that loss of control and loss of understanding are the same things.

A board of directors at, like, whatever, TSMC, Intel, name a random company, they're just, like, prestigious 80-year-olds.

They have very little understanding.

And maybe they don't practically actually have control.

But...

Or, actually, maybe a better example is the president of the United States.

The president has a lot of fucking power.

I'm not trying to make a good statement about the current operant, but maybe I am.