Rob Wachen
speaker
529 appearances
1 recordings
1 series
first heard Jun 2026
last heard 30 Jun
Rob Wachen’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jun 2026 with 1.
Appearances
The way we organize our flops, the way we do our voltage domains, the way we do our power planes are going to look super different.
The way we do the packaging is going to look super different.
The way we do the board design is going to look different.
And then the decode side, the way we connect everything is going to look very different.
So we're now bringing forward our first generation of this low voltage inference technology, which is running at under half the voltage of any other AI chip.
Well, I think it comes down to productivity, where we are at this extremely interesting moment in the history of civilization where there's real artificial intelligence.
Not sci-fi stuff, but these models can solve problems that most humans can't.
And it's going to create new scientific discoveries.
It's going to create instant access to medical care, instant access to education.
And now it's just about how many people can use this at the same time, how many products can serve this at the same time, and also the speed of doing different tasks.
So when you think about wall clock time, if we can take an agent that can run at a certain model quality and could take a year to solve a certain task using inference time compute,
If you have way faster decode speed, you can compress that into a month.
So the amount of scientific innovation and the amount of actual proliferation of technology will happen much faster.
And then the second part is concurrency, where today it's just not possible for a billion people to use these models concurrently.
Ultimately, some people are going to get downgraded.
Some people's model is going to be slower.
Some people just won't be able to access the hardware.
A few years from now, there's going to be giant models serving billions of users.
We're very much in the early innings of AI today where the paid plans, there's only a few million users in the world using paid plans of AI models.
So we're at one one-thousandth of the global population actually using this stuff.
Showing 61–80 of 529 · page 4 of 27
← Previous
Next →