Nathan Lambert

LLMs, even the best LLMs in particularly pretty good benchmarks don't get 100%, right? They get a little bit below that because there's a lot of noise. And so... How do you get to enough nines, right? This is the same thing with self-driving. We can't have self-driving because without it being like super geo-fenced like Google's, right?

And even then they have a bunch of teleoperators to make sure it doesn't get stuck, right? But you can't do that because it doesn't have enough nines.

And even then they have a bunch of teleoperators to make sure it doesn't get stuck, right? But you can't do that because it doesn't have enough nines.

And even then they have a bunch of teleoperators to make sure it doesn't get stuck, right? But you can't do that because it doesn't have enough nines.

There is a company, I don't remember what it is, but that's literally their pitch is, yeah, we're just going to be the human operator when agents fail. And you just call us and we fix it.

There is a company, I don't remember what it is, but that's literally their pitch is, yeah, we're just going to be the human operator when agents fail. And you just call us and we fix it.

There is a company, I don't remember what it is, but that's literally their pitch is, yeah, we're just going to be the human operator when agents fail. And you just call us and we fix it.

Or like, they just like, here's an API and it's only exposed to AI agents. And if anyone queries it, the price is 10% higher and for any flight, but we'll let you see any of our flights and you can just book any of them.

Or like, they just like, here's an API and it's only exposed to AI agents. And if anyone queries it, the price is 10% higher and for any flight, but we'll let you see any of our flights and you can just book any of them.

Or like, they just like, here's an API and it's only exposed to AI agents. And if anyone queries it, the price is 10% higher and for any flight, but we'll let you see any of our flights and you can just book any of them.

And then it's like, oh, and I made 10% higher price. Awesome. Yeah. And like, am I willing to say that for like, hey, book me a flight to see Lex, right? And it's like, yeah, whatever. Yeah. Yeah. Okay. I think computers and real world and the open world are really, really messy.

And then it's like, oh, and I made 10% higher price. Awesome. Yeah. And like, am I willing to say that for like, hey, book me a flight to see Lex, right? And it's like, yeah, whatever. Yeah. Yeah. Okay. I think computers and real world and the open world are really, really messy.

And then it's like, oh, and I made 10% higher price. Awesome. Yeah. And like, am I willing to say that for like, hey, book me a flight to see Lex, right? And it's like, yeah, whatever. Yeah. Yeah. Okay. I think computers and real world and the open world are really, really messy.

But if you start defining the problem in narrow regions, people are going to be able to create very, very productive things. And ratchet down cost massively, right? Like now crazy things like, you know, robotics in the home, you know, those are going to be a lot harder to do just like self-driving, right? Because there's just a billion different failure modes, right?

But if you start defining the problem in narrow regions, people are going to be able to create very, very productive things. And ratchet down cost massively, right? Like now crazy things like, you know, robotics in the home, you know, those are going to be a lot harder to do just like self-driving, right? Because there's just a billion different failure modes, right?

But if you start defining the problem in narrow regions, people are going to be able to create very, very productive things. And ratchet down cost massively, right? Like now crazy things like, you know, robotics in the home, you know, those are going to be a lot harder to do just like self-driving, right? Because there's just a billion different failure modes, right?

But, but like agents that can like navigate a certain set of websites and do certain sets of tasks. Or like, look at, you know, look at your, you know, take a photo of your groceries, your fridge and or like upload your recipes. And then like it figures out what to order from, you know, Amazon slash Whole Foods food delivery.

But, but like agents that can like navigate a certain set of websites and do certain sets of tasks. Or like, look at, you know, look at your, you know, take a photo of your groceries, your fridge and or like upload your recipes. And then like it figures out what to order from, you know, Amazon slash Whole Foods food delivery.

But, but like agents that can like navigate a certain set of websites and do certain sets of tasks. Or like, look at, you know, look at your, you know, take a photo of your groceries, your fridge and or like upload your recipes. And then like it figures out what to order from, you know, Amazon slash Whole Foods food delivery.

Like that's then that's going to be like pretty quick and easy to do, I think. So it's going to be a whole range of like business outcomes. And it's going to be tons of tons of sort of optimism around people can just figure out ways to make money.