Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Illia Polosukhin

๐Ÿ‘ค Speaker
1100 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And we were trying to build what now is called vibe coding.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So in 2017, we were effectively saying, hey, just describe what app you want to build and we'll generate it for you.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And, you know, it didn't really work very well because we didn't have enough, you know, GPU compute power.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

But, you know, this is actually how we got to blockchain.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

But I would just say, like, we expected Canada's growth to continue.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And actually...

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

It was more disappointing that it didn't.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And it took some time until 22 for that to pick up.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And now we're actually writing this exponential.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And I think now we're in inflection point from a resource and attention perspective because there's just so much...

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

kind of focus on this now that I effectively never been.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And I think because of this is just the rate of, rate of innovation is so much higher, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Like the amount of, you know, money put in a compute, like all of those things are just like, you know,

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

The numbers are crazy comparative to like five, seven years ago where, you know, you would train on like a single GPU and you feel super cool.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And now you're like, hey, 100,000 GPU cluster.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Like, what is this?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Amateur hour?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah, so I think generally we're in a section from kind of rate of research and innovation that's happening.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Obviously, it's hard to predict different levels of kind of quality of models and also just adoption.