Illia Polosukhin
๐ค SpeakerAppearances Over Time
Podcast Appearances
And we were trying to build what now is called vibe coding.
So in 2017, we were effectively saying, hey, just describe what app you want to build and we'll generate it for you.
And, you know, it didn't really work very well because we didn't have enough, you know, GPU compute power.
But, you know, this is actually how we got to blockchain.
But I would just say, like, we expected Canada's growth to continue.
And actually...
It was more disappointing that it didn't.
And it took some time until 22 for that to pick up.
And now we're actually writing this exponential.
And I think now we're in inflection point from a resource and attention perspective because there's just so much...
kind of focus on this now that I effectively never been.
And I think because of this is just the rate of, rate of innovation is so much higher, right?
Like the amount of, you know, money put in a compute, like all of those things are just like, you know,
The numbers are crazy comparative to like five, seven years ago where, you know, you would train on like a single GPU and you feel super cool.
And now you're like, hey, 100,000 GPU cluster.
Like, what is this?
Amateur hour?
Yeah.
Yeah, so I think generally we're in a section from kind of rate of research and innovation that's happening.
Obviously, it's hard to predict different levels of kind of quality of models and also just adoption.