Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Illia Polosukhin

👤 Person
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So users consume the models through compute, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So they pay at the end for everything.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Some portion goes to compute, to GPU providers.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And, you know, it can be, you know, your usual monthly subscription and gets divided by all of the compute providers, you know, portion of that.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Then portion goes to the models that they used.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So let's say we use, you know, DeepSeq.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

DeepSeq, for example, wants to charge additional, on top of compute, can charge, you know, additional 10 cents per million tokens or something.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So they get received, again, from the subscription or from API that cost.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And then if the data is used at inference time, then it's accounted there as well.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So think of it as like Spotify, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

This is a stream of that.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

But if it's used at training, then it's a little bit different mechanism because at training time, we cannot actually attribute exact usage of exact data, right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Because like model will compress everything at the end.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so instead, what we want to offer, if you kind of use the data from this kind of system, you can get portion of so-called model token.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So model token then is a way to receive revenue from this model being used.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so you're kind of getting the upside of this model being used in production.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah, so we kind of offer this environment where if you already have built a model, you can just upload it and charge for it.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

If you're a content creator that has a paywalled content, you can upload it and receive it only at inference time, so it's not going to be used at training time.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And if it's an open content...

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

and people training a model in our system using this content, then they'll receive it.