Eiso Kant
speaker
1,158 appearances
1 recordings
1 series
first heard Jul 2026
last heard 23 Jul
Eiso Kant’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
After I texted you, I realized that probably coming in with major jet lag was going to offer some fun experiences today, but let's do it.
Actually, I don't think it's obvious how I got in this space.
I owe getting into this space to Andrej Karpathy.
In 2015, he wrote an article called The Unreasonable Effectiveness of Recurrence.
And that article, I read it, and I pivoted my startup at the time overnight to working on RNNs and later LSTMs and transformer models to be able to write code.
If you go to this article and you scroll down,
You can kind of start seeing, like, this was the precursor to what ended up becoming language models.
So, at least when he was character-level language models that were starting to actually predict letters.
He has an example out here.
There's a little Paul Graham generator.
And you can kind of read it, and the text kind of makes sense, but it doesn't.
And there's an example of code a little bit further down.
It says Shakespeare.
And...
And for some reason, I read this and I went down the rabbit hole of learning everything I could about RNNs and LSTMs, right?
This is pre-transformer paper.
And I had built a completely unreasonable belief that neural nets should be able to generalize to anything and everything.
And that language should be able to generalize, you know, to a lot of things that are intelligence and the ability to write code.
And so I started building Sourced, which was a fully open source company, trying to build what we used to call machine learning on code, language models on code.
And we spent about four or five years on this till the end of 2019.
Showing 1–20 of 1,158 · page 1 of 58
Next →