Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Illia Polosukhin

👤 Person
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

But again, this is like only in that condition because we cannot track if somebody else doing it somewhere else.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

But the idea is like, you know, as kind of the network effects here, you know, kind of come from every direction, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

The more usage come in, the more, you know, people want to serve their models because their users are

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

the more computers there because more users are using it, more models are there, the more content people want to upload because more things are getting paid versus not getting paid anywhere else.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So this is kind of like a system to really combine all those different components into one

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

kind of vision of this user on the eye where, you know, we know where data comes in.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

We have the providence.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

We know kind of how models are trained.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

We have the compute that's available around the world.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

I mean, compute is also like a really big challenge because right now, if I'm a model developer, I'm a closed source model developer.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

I actually don't trust other model, like other compute providers.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Like that's why people trying to like have access to their own GPUs because if they give weights to somebody else, they don't know if those people will leak them.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So actually solving a trust problem between model builders and compute providers as well while we're doing it.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And this allows to actually distribute the compute because of this kind of control, the companies you guys know, all building massive clusters.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

I mean, they're useful for training, but then for inference, they still use them as well because again, of this afraid.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so here you can actually have cluster in Japan and in Norway, in maybe Nigeria,

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

in Brazil that actually serve the local markets, lower latency, you know, better energy efficiency, et cetera.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

It's a smaller cluster.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

It serves only this.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And then you don't have any trust issues between all those parties, right?