Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Balaji Srinivasan

πŸ‘€ Speaker
2887 total appearances

Appearances Over Time

Podcast Appearances

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

So there was a very good counterargument that actually said that this study does not purport to show what people think it's purporting to show and that the task completion, it's like –

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

it's much more questionable than it actually looks, right?

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

And this is important because a lot of people's paranoia and stuff is levered on this.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

Yeah, that's it.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

I think that's it.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

Against the meta graph, right?

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

Yeah, can we pull that up?

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

Pull that up, right?

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

So yes, this was like, this deserves more people looking.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

But fundamentally, he says, actually, you know, the graph doesn't really look like this because A, a lot of the tasks aren't.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

And B, like what is completion?

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

You know, they're TLDR.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

Now, I don't want to overstate this because it's certainly true at a gestalt level that if you use Claude code or Claude co-work or something like that, it is possible for AI to complete long, complicated tasks than it could a few years ago.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

That's clearly true.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

However, it's also true that you still have to supervise it a lot and check the output.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

It's a little bit like, you know, I compare it to a spaceship that can go in any, like, you know, coordinate direction that you point it in and move very fast, pivoting it and give it the route that it's moving on.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

It's like a car.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

It'll take you there very fast, but then you have to still give it a direction, and now the new thing is everybody's got a car, so now car race as opposed to you just being able to teleport somewhere, right?

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

Okay.

The a16z Show
Balaji Srinivasan: Prove Correct, Not Just Go Direct

So this guy is pretty critical of it, and...