Dwarkesh

Yeah, meaning what?

Meaning what?

Yeah.

Another thing that's crazy is like how normal the slow takeoff feels.

The idea that we'd be investing 1% of GDP in AI, like I feel like it would have felt like a bigger deal, you know, where right now it just feels like.

Yeah.

Should we actually begin here?

I think this is an interesting discussion.

Sure.

I think your point about, well, from the average person's point of view, nothing is that different will continue being true even into the singularity.

No, I don't think so.

Okay, interesting.

When do you expect that impact?

I think the models seem smarter than their economic impact would imply.

I like this idea that the real reward hacking is the human researchers who are too focused on the evals.

I think there's two ways to understand or to try to think about what you have just pointed out.

One is, look, if it's the case that simply by becoming superhuman at a coding competition, a model will not automatically become more tasteful

and exercise better judgment about how to improve your code base, well, then you should expand the suite of environments such that you're not just testing it on having the best performance in a coding competition.

It should also be able to make the best kind of application for X thing or Y thing or Z thing.

And another, maybe this is what you're hinting at, is to say, why should it be the case in the first place that...