Nathan Lambert
๐ค SpeakerAppearances Over Time
Podcast Appearances
Like that's then that's going to be like pretty quick and easy to do, I think. So it's going to be a whole range of like business outcomes. And it's going to be tons of tons of sort of optimism around people can just figure out ways to make money.
Like that's then that's going to be like pretty quick and easy to do, I think. So it's going to be a whole range of like business outcomes. And it's going to be tons of tons of sort of optimism around people can just figure out ways to make money.
There's a lot of fear and angst too from current CS students, but there's also, that's where, that is the area where probably the most AI revenue and productivity gains have come, right?
There's a lot of fear and angst too from current CS students, but there's also, that's where, that is the area where probably the most AI revenue and productivity gains have come, right?
There's a lot of fear and angst too from current CS students, but there's also, that's where, that is the area where probably the most AI revenue and productivity gains have come, right?
Um, whether it be co-pilots or cursor or, uh, what have you, right? This is, or just standard chat GPT, right? Like a lot of, I don't, I know very few programmers who don't have chat GPT and actually many of them have the $200 tier because that's what it's, it's so good for, right? Um, I think that in that world, uh, we already see it like sweep bench.
Um, whether it be co-pilots or cursor or, uh, what have you, right? This is, or just standard chat GPT, right? Like a lot of, I don't, I know very few programmers who don't have chat GPT and actually many of them have the $200 tier because that's what it's, it's so good for, right? Um, I think that in that world, uh, we already see it like sweep bench.
Um, whether it be co-pilots or cursor or, uh, what have you, right? This is, or just standard chat GPT, right? Like a lot of, I don't, I know very few programmers who don't have chat GPT and actually many of them have the $200 tier because that's what it's, it's so good for, right? Um, I think that in that world, uh, we already see it like sweep bench.
And if you've looked at the benchmark, uh, made by some Stanford students, uh, I wouldn't say it's like really hard, but I wouldn't say it's easy either. I think like it takes someone who's been through at least, you know, a few years of CS or a couple of years of programming to do sweep bench well. And the models went from 4% to 60% in like a year, right?
And if you've looked at the benchmark, uh, made by some Stanford students, uh, I wouldn't say it's like really hard, but I wouldn't say it's easy either. I think like it takes someone who's been through at least, you know, a few years of CS or a couple of years of programming to do sweep bench well. And the models went from 4% to 60% in like a year, right?
And if you've looked at the benchmark, uh, made by some Stanford students, uh, I wouldn't say it's like really hard, but I wouldn't say it's easy either. I think like it takes someone who's been through at least, you know, a few years of CS or a couple of years of programming to do sweep bench well. And the models went from 4% to 60% in like a year, right?
And where are they going to go to next year? You know, it's going to be higher. It probably won't be 100% because again, that nines is like really hard to do. But we're going to get to some point where that's, and then we're going to need harder software engineering benchmarks and so on and so forth. But the way that people think of it now is it can do code completion easy.
And where are they going to go to next year? You know, it's going to be higher. It probably won't be 100% because again, that nines is like really hard to do. But we're going to get to some point where that's, and then we're going to need harder software engineering benchmarks and so on and so forth. But the way that people think of it now is it can do code completion easy.
And where are they going to go to next year? You know, it's going to be higher. It probably won't be 100% because again, that nines is like really hard to do. But we're going to get to some point where that's, and then we're going to need harder software engineering benchmarks and so on and so forth. But the way that people think of it now is it can do code completion easy.
It can do some function generation and have to review it. Great. But really, the software engineering agents, I think, can be done faster, sooner than any other agent because it is a verifiable domain. You can always unit test or compile. And there's many different regions of... It can inspect the whole code base at once, which no engineer really can.
It can do some function generation and have to review it. Great. But really, the software engineering agents, I think, can be done faster, sooner than any other agent because it is a verifiable domain. You can always unit test or compile. And there's many different regions of... It can inspect the whole code base at once, which no engineer really can.
It can do some function generation and have to review it. Great. But really, the software engineering agents, I think, can be done faster, sooner than any other agent because it is a verifiable domain. You can always unit test or compile. And there's many different regions of... It can inspect the whole code base at once, which no engineer really can.
Only the architects can really think about this stuff, the really senior guys, and they can define stuff. And then the agent can execute on it. So I think software engineering costs are going to plummet like crazy. And one interesting aspect of that is when software engineering costs are really low, you get very different markets, right?
Only the architects can really think about this stuff, the really senior guys, and they can define stuff. And then the agent can execute on it. So I think software engineering costs are going to plummet like crazy. And one interesting aspect of that is when software engineering costs are really low, you get very different markets, right?
Only the architects can really think about this stuff, the really senior guys, and they can define stuff. And then the agent can execute on it. So I think software engineering costs are going to plummet like crazy. And one interesting aspect of that is when software engineering costs are really low, you get very different markets, right?