Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Tim Davis

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Yeah.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Yeah, so how we, you know, I can talk a little bit about our platform.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So how we started was we recognized at Google that one of the biggest challenges is that most software that people interact with today is built on top of what hardware manufacturers build for their chips.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So at the end of the day, you write a program, it needs to map to the silicon that it's executing on.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But the challenge is every hardware manufacturer comes out with its own stack.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So, you know, NVIDIA has CUDA, AMD has ROKM.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I mean, you could go through all the different silicon providers.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So where we started was to say, is there a world where we could build an independent software stack that enables us to bring up hardware without needing to rely on...

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

on the vendors, you know, libraries and infrastructure.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so that was sort of the big challenge.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So one of the things we built, and I say this lovingly that, uh, that, that Chris Lightner, my, my co-founder, um, he doesn't need much, um, incentive to build a new programming language.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

He, uh, he loves, you know, I mean, this has been in many ways, his, his last work, but, uh,

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So what we realized, though, was the problem was, was there a way to build an abstraction where we could essentially write programs that became portable by nature?

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And there's a lot to that.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I could go into more detail.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But fundamentally, the concept is, could you write software, particularly AI software, very low-level operations, that would enable you to go across different types of hardware easily?

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Kind of a translator, sort of?

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Yeah, except it's a brand new programming language.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So we actually rely on some technology we built at Google called MLIR, which stands for, and this might go too low level, but it stands for multi-level intermediate representation.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

So it's about building a representation of a program that can go across different types of silicon.