Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Illia Polosukhin

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

It's a very peer-to-peer network, as you can see.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And again, this is what blockchain is, is a peer-to-peer network of, you know, kind of facilitating value transfer and kind of trust in a permissionless way.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so that's really what we're going after.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah, I think... So important component is if we know what training data went in, if we know kind of how it was trained, there's a lot more tools to do explainability, why it made this decision.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Right?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

To give you an example that I kind of... I had this experience at Google where...

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

we were training a model for question answering.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

You ask it, you know, we had like a test set where Barack Obama was born and its reply was Kenya.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And you're like, huh?

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so you go in, like you look at training data and it's because there's a bunch of websites that talk about Barack Obama was born in Kenya.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Right.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so, you know, being an engineer, you're like, hey, you know, I need to improve my model.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

So you remove the websites.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Yeah.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And, you know, naturally the model becomes more left leaning because you just removed a bunch of right leaning websites.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

We talked about that.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so all of those decisions, they're not malicious in any way, but you don't know what's happening.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Unless you see the training data, you don't know what the outcome model, what biases it has and how it arrived to this.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

Exactly, yeah.

The Neuron: AI Explained
Illia Polosukhin: Fixing the Broken System He Helped Create

And so it's really important to have that visibility and kind of traceability for this, because that will give you indeed better explainability on why those decisions are made.