Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Ben Buchanan

๐Ÿ‘ค Speaker
266 total appearances

Appearances Over Time

Podcast Appearances

The Ezra Klein Show
The Government Knows AGI is Coming

you you

The Ezra Klein Show
The Government Knows AGI is Coming

you you

The Ezra Klein Show
The Government Knows AGI is Coming

I met with him once. I don't know exactly, but I met with him once. Would that characterize the conversation he had with you? He talked about concerns related to startups and competitiveness and the like. I think my view on this is you look at our record on competitiveness, it's pretty clear that we want a dynamic ecosystem.

The Ezra Klein Show
The Government Knows AGI is Coming

I met with him once. I don't know exactly, but I met with him once. Would that characterize the conversation he had with you? He talked about concerns related to startups and competitiveness and the like. I think my view on this is you look at our record on competitiveness, it's pretty clear that we want a dynamic ecosystem.

The Ezra Klein Show
The Government Knows AGI is Coming

So the AI executive order, which President Trump just repealed, had a pretty lengthy section on competitiveness. The Office of Management and Budget Management Memo, which governs how the U.S. government buys AI, had a whole carve-out in it or a call-out in it saying we want to buy from a wide variety of vendors. The Chips and Science Act has a bunch of things in there about competition.

The Ezra Klein Show
The Government Knows AGI is Coming

So the AI executive order, which President Trump just repealed, had a pretty lengthy section on competitiveness. The Office of Management and Budget Management Memo, which governs how the U.S. government buys AI, had a whole carve-out in it or a call-out in it saying we want to buy from a wide variety of vendors. The Chips and Science Act has a bunch of things in there about competition.

The Ezra Klein Show
The Government Knows AGI is Coming

So I think our view on competition is pretty clear. Now, I do think there are structural dynamics related to scaling laws and the like that will force things towards big companies that I think in any respects we were pushing against. I think the track record is pretty clear of us in competition.

The Ezra Klein Show
The Government Knows AGI is Coming

So I think our view on competition is pretty clear. Now, I do think there are structural dynamics related to scaling laws and the like that will force things towards big companies that I think in any respects we were pushing against. I think the track record is pretty clear of us in competition.

The Ezra Klein Show
The Government Knows AGI is Coming

Yeah, so in the president's executive order, we actually tried to wrestle with this question, and we didn't have an answer when that order was signed in October of 23. And what we did on the open source question in particular, and I think we should just be precise here at the risk of being academic again, what we're talking about are open weight systems.

The Ezra Klein Show
The Government Knows AGI is Coming

Yeah, so in the president's executive order, we actually tried to wrestle with this question, and we didn't have an answer when that order was signed in October of 23. And what we did on the open source question in particular, and I think we should just be precise here at the risk of being academic again, what we're talking about are open weight systems.

The Ezra Klein Show
The Government Knows AGI is Coming

Can you just say what weights are in this context and then what open weights are? Yeah, so when you have the training process for an AI system, you run this algorithm through this huge amount of computational power that processes the data.

The Ezra Klein Show
The Government Knows AGI is Coming

Can you just say what weights are in this context and then what open weights are? Yeah, so when you have the training process for an AI system, you run this algorithm through this huge amount of computational power that processes the data.

The Ezra Klein Show
The Government Knows AGI is Coming

the output at the end of that training process, loosely speaking, and I stress this as the loosest possible analogy, they are roughly akin to the strength of connections between the neurons in your brain. And in some sense, you could think of this as the raw AI system.

The Ezra Klein Show
The Government Knows AGI is Coming

the output at the end of that training process, loosely speaking, and I stress this as the loosest possible analogy, they are roughly akin to the strength of connections between the neurons in your brain. And in some sense, you could think of this as the raw AI system.

The Ezra Klein Show
The Government Knows AGI is Coming

And when you have these weights, one thing that some companies like Meta and DeepSeek choose to do is they publish them out on the internet, which makes them, we call them open weight systems. And the crucial thing about an open weight system on the good side is that It's much easier to innovate with that system, to use it as a basis for future systems because you've got access to the raw thing.

The Ezra Klein Show
The Government Knows AGI is Coming

And when you have these weights, one thing that some companies like Meta and DeepSeek choose to do is they publish them out on the internet, which makes them, we call them open weight systems. And the crucial thing about an open weight system on the good side is that It's much easier to innovate with that system, to use it as a basis for future systems because you've got access to the raw thing.

The Ezra Klein Show
The Government Knows AGI is Coming

On maybe the riskier side is any safeguards that were built into that system. Refuse when a user asks you to help develop a biological weapon are pretty easy to remove. I'm a huge believer in the open source ecosystem. Many of the companies that publish the ways for their system do not make them open source. They don't publish the code and the like.

The Ezra Klein Show
The Government Knows AGI is Coming

On maybe the riskier side is any safeguards that were built into that system. Refuse when a user asks you to help develop a biological weapon are pretty easy to remove. I'm a huge believer in the open source ecosystem. Many of the companies that publish the ways for their system do not make them open source. They don't publish the code and the like.

The Ezra Klein Show
The Government Knows AGI is Coming

So I don't think they should get the credit of being called open source systems at the risk of failure. Being pedantic. But open weight systems is something we thought a lot about in 23 and 24. And we sent out a pretty wide ranging request for comment for a lot of folks. We got a lot of comments back.

The Ezra Klein Show
The Government Knows AGI is Coming

So I don't think they should get the credit of being called open source systems at the risk of failure. Being pedantic. But open weight systems is something we thought a lot about in 23 and 24. And we sent out a pretty wide ranging request for comment for a lot of folks. We got a lot of comments back.