Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Illia Polosukhin

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so being able to just like describe the front end and see changes you go has been really like kind of different experience.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So I leverage that.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And then I use every single model to test them out.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And then obviously near AI private for actual, you know, real use cases.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah, no, that's awesome.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Well, I mean, we're trying to do that, you know.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

I think the open source is effectively the principle.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

I think, I mean, imagine if transformers were published and open sourced.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

We actually wouldn't even maybe, like, because Google wasn't leveraging, like, Google was using it for translate, but it wasn't, like, leveraging it at, like, larger scale.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so we wouldn't actually maybe have like this explosion either.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And then, I mean, the transformer itself is built on ton of research of other people, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Like the concept of attention came from, you know, researchers, I think from Meta, if I'm not mistaking, and from Montreal University as well.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

The, you know, there's obviously all the work from before.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So like,

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

It's, you know, PyTorch like we're all using.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So like open source, I think it's the core of this and core of innovation.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And it's kind of sad that we are not there anymore.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

I mean, I don't think it's a bad...