Illia Polosukhin

speaker

1,913 appearances 93 recordings 19 series first heard Feb 2020 last heard 6d ago

Illia Polosukhin’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 53 in all, peaking in Jun 2026 with 9.

Appearances

newest first · ▶ plays the moment

The Neuron: AI Explained · Illia Polosukhin: Fixing the Broken System He Helped Create · 12 Sep 2025 podcast

They all come from China, which there's nothing wrong in theory about this, but we have no idea what they are trained on.

So we, again, don't know what the biases are.

And there's this concept of sleeper agents where you can actually train in a specific way the model where it will not show up in benchmarking, it will not show up in normal usage, but in a specific context under specific conditions, it will change its output.

Right.

So you can actually literally train like very specific activations.

There's some research on that.

And so like, again, we have no idea if that was trained like that or not.

I mean, I'm assuming not, but we don't know.

And so it is especially like if you're using it for financial, for medical, for legal, for any of these reasons, like you actually have no confidence in the outcome.

So ideally, we should have a model where we know what went in, all the inputs and how it was trained.

Now, the challenge was that, even the challenge was open source in general, is that there's no monetization, right?

There's no way, if I build really cool model, I spend hundreds of thousands of millions of dollars to train it, there's no way for me to make money of this.

Because it's open source, now everybody's using it, you can not pay me.

So we kind of need a new model

Yeah, exactly.

And it's kind of like... It's a strange model because...

what it sends up is actually kind of like the startups don't want to take on that risk because like, you know, as soon as you target you, like your costs are exploding.

And so you're going to take the open source models that are, don't have this license and the individuals, right.

Who, you know, would want to use this, would just use it locally or whatever through services directly.

Yeah.

Showing 1181–1200 of 1,913 · page 60 of 96