Eiso Kant
speaker
1,158 appearances
1 recordings
1 series
first heard Jul 2026
last heard 23 Jul
Eiso Kant’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
But I actually think you can sum down
And I saw 95% of model building to just doing, you're just doing two things.
You're improving data or you're improving compute efficiency.
And I know that feels like an oversimplification for the incredible like gifted and skilled work people do.
But if you really look at it, like what are we doing?
We are...
looking at data, we're generating new data, we're improving data.
And the only way to do that is to look at the data, right?
That's a big part of foundation modeling.
And on the other hand, we come up with these incredible breakthroughs in inference, in architecture, and new attention mechanisms.
But what are they really doing?
They're bringing compute efficiency.
Now, we have definitely had some breakthroughs over the years that allow for more model capabilities.
But at the limit, if you could train a large enough model, right, like you had infinite compute, if you had infinite compute, you'd be at AGI probably already tomorrow.
Like it's not – and so – and let me say that infinite compute with infinite ability of much faster networking because networking ends up being more of the bottleneck than compute.
But – so I do think that that's – those are the main things.
And to just realize that this is engineering.
I think it's become more obvious.
But I think for quite a few years, people have held foundation model companies and researchers and others on this pedestal of like you're doing –
credible magic or rocket science or only like, you know, Nobel laureate physicists can do this.
Showing 321–340 of 1,158 · page 17 of 58
← Previous
Next →