Illia Polosukhin
speaker
714 appearances
3 recordings
1 series
first heard Oct 2024
last heard Sep 2025
Illia Polosukhin’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
For sure, yeah.
No, that's that's good deep research there.
Um so my background is in machine learning and and AI.
Um I joined Google kind of this when I saw I d I don't know if you remember this cat neuron paper where the effective trained an auto encoder model, meaning like they would feed the images and like compress it and uncompress it to get the bags the same.
Image and that model trained on a bunch of images on the internet figured out that there's a cat.
And so there was a neuron specifically that if you activate it would show up as a cat.
And so for me it was like this is the approach.
Neural networks working now.
But I think images are not where the knowledge and intelligence lies.
I think the text is.
Google was very much like, hey, how do we focus deep learning on natural language?
And the straightforwardest path to kind of advance and check intelligence of any you know human or machine is to ask questions.
So my team worked on question answering, and we actually had even some of this in the product on google.com.
back in the day before Gemini you would get this short answers
And part of the challenge we had was actually
Like the models that were state of the art were too slow, right?
You couldn't, you know, the long short-term memory like LSTM models, right?
They need to read one word at a time.
And so, you know, if if you feed them a bunch of articles from Google search results, right, there's like it'll take forever for them to respond.
And so that's actually how Transformers, you know, was one of the motivations, like, hey, how do we consume all this context effectively?
Showing 1–20 of 714 · page 1 of 36
Next →