Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Tim Davis

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But I would certainly say many of the decisions that were made at companies like Meta and Google to build these AI frameworks on top of CUDA as a programming model for NVIDIA's acceleratable compute

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

really acted as a massive distribution mechanism for them to get very mass scale.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

It accelerated the adoption and penetration of execution of models on NVIDIA's hardware.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And if you look at other folks, at the time those decisions were made in frameworks like TensorFlow and PyTorch and others, it was the best thing around.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so people went, well, let's just use that.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But by doing that, they obviously changed the...

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

You know, the trajectory, certainly for NVIDIA, and I'm sure many happy stockholders at that company, but also, you know, more broadly on how other companies can come and compete, right?

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Yeah.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I think a lot of what we fundamentally believe is not only is a unified compute model good for penetration of applications, both at the data center and the edge, it's also good just for competition.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

It makes it possible for more people to compete and there'll be more innovation at the silicon side of it.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But Grant, you also asked,

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

You know, all of these deals and all of this sort of circular money flow.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Right.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

You know, I think there's been parallels drawn and there's a guy, Tomas Tungs, who's a former VC and he has a blog.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

He has a wonderful blog post on this.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Sort of comparing it back to, you know, when we were laying fiber back in, you know, in 2000s.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And I think the difference, of course, now is I don't...

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I think that GPU utilization around the world right now, most GPUs are probably running reasonably hot, given the amount of AI that's being consumed.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I think it is a very different time to what was happening, certainly in America, when we were laying fiber, and it just wasn't being utilized yet.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And then, of course, across the arc of 20 years, that's changed.