Illia Polosukhin
๐ค SpeakerAppearances Over Time
Podcast Appearances
You know, here's the questions you need to ask in following one-on-ones, right?
So yes, it's not replacing maybe like full employee, but it's becoming like a chief of staff.
It's becoming the assistant.
It's becoming an intern for some specific jobs before you would kind of offload.
I think where we'll see advancements on the AI side is the context.
I think that right now, like everybody feels it, right?
The context links.
I mean, where you saw all this entropic push to million token context, like every time effectively compaction hits in cloud code, for example, it just becomes like 10 times dumber.
And so, I mean, OpenCloset kind of have some of that as well.
So is that the main thing for these agents to be useful?
I think that's right now one of the biggest bottlenecks, yeah.
It's like the amount of momentum that's happening kind of with this.
And the reality is like there's actually historically, if you think of like when you train these models, there hasn't been that much of things where you needed the context of,
Like million tokens is like, whatever, few Harry Potter books, right?
Ah, it's not much.
There's nothing to train on, like at scale.
But now we do have this, right?
Now we actually have a lot of this agentic interactions now that everybody's running.
So there's actually data now to train this like longer range task.
I'm pretty confident, yeah.