Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Tim Davis

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

You know, you fast forward a decade.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Now it's like, not only do we want our data in the cloud, now we want to be multi-cloud.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so, I think your analogy is interesting, but I think the actual inferencing process and the speed at which it has to happen and the latency at which meaningful results have to return to the user.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And there's a quoted statistic that we used to use in Google search was,

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

but every 100 milliseconds of latency, it was 1% on revenue.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And I think that's been validated also by Amazon.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So in the real world, like if you think about deploying, you know, just on a CPU, for example, in an autonomous vehicle, could you imagine flying down a freeway and I don't know, a ball floats out onto the freeway and because the CPU just is not as powerful as a large, you know, parallel, just in terms of flops and processing,

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

The car will have hit the ball and be another two miles down the road before you get an inference response that says, watch out for the ball.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I think that's the practical reality, though, that any future system, any future form of intelligence needs to be able to have...

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And I think we, as humans, have this sort of biological process that we've inherited over generations.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But it is incredible that we are able to process so fast and respond so quickly to things.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And I think computationally, a CPU can't get us there.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So then the question is, in the real world, I don't know if you've been in a Waymo.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Not yet, but I hope to this month.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

They are marvels in the sense of, and we can talk about all the different, the sensors and the different approaches on those sensors on those vehicles.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But at the end of the day, you do need a degree of processing power against some battery capacity and thermal thresholds that enable intelligence to respond quickly.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Because everyone I think is optimizing now for a high degree of perceived intelligence at the fastest possible outcome.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And I think it's actually the nature of consumer behavior over time because of internet products that have been created over the last 20 years.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And I think Google is obviously a big leader there, but that's not to say that Amazon and Meta and other organizations haven't done incredible work.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But what we have done is train everyone to get everything instantly.