Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Illia Polosukhin

๐Ÿ‘ค Speaker
1100 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

giving actually better properties, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Because everything private from the user perspective, the models don't get leaked, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Because they always exist encrypted and only decrypt inside this customization environment.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And it also offers you a way to even monetize for creators their data.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So let's say you record this podcast, it gets scraped, it gets used for

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

training you know we got nothing or you can upload it into this network and if it's used for inference or even for training we can receive something as creators of this podcast or you guys in this case right so that's interesting so when does the payment happen then does it happen like when like the person who trains the model then takes it out and charges users for it like when when would you get paid in that model as a creator

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah, so because it's kind of a three-sided marketplace, or actually like even four-sided because you have compute.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So a few things happen, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So users consume the models through compute, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So they pay at the end for everything.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Some portion goes to compute, to GPU providers.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And, you know, it can be, you know, your usual monthly subscription and gets divided by all of the compute providers, you know, portion of that.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Then portion goes to the models that they used.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So let's say we use, you know, DeepSeq.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

DeepSeq, for example, wants to charge additional, on top of compute, can charge, you know, additional 10 cents per million tokens or something.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So they get received, again, from the subscription or from API that cost.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And then if the data is used at inference time, then it's accounted there as well.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So think of it as like Spotify, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

This is a stream of that.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

But if it's used at training, then it's a little bit different mechanism because at training time, we cannot actually attribute exact usage of exact data, right?