Eiso Kant

speaker

1,158 appearances 1 recordings 1 series first heard Jul 2026 last heard 23 Jul

Eiso Kant’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.

newest first · ▶ plays the moment

And that sounds really cool today, but back then, no one cared.

Right.

Like no one cared.

We were in the dark.

Like we did things along the way.

We tried applying convolutional neural nets to like the structure of code.

We were, you know, when attention came out, we were applying it to LSTMs and then the transformer paper came out and it was, it wasn't obvious.

And what we missed throughout that entire journey that we were on the right track, but we should have just kept scaling up.

And today, to all of us, the scaling laws and scaling up seems like the most obvious thing.

But having spent four or five years of my life on working on language models on code, it wasn't obvious.

I have a lot of respect to folks at Google and OpenAI and others who kind of took that confidence and kept going.

And we failed ultimately at the time.

And it kind of was like biggest failure of my career, right?

You blew $12 million of investors' money, which was a lot back then.

You spent still a lot, and you spent years with like a group of 40 people just obsessing over this problem.

and life took a different turn, and family kind of became a focus, and I kind of kept my heads down.

I really, frankly, didn't really look at language models for the following two years.

Kind of a big mistake, considering the following years are going to be really interesting.

And then ChatGPT came out.

And it was kind of like a vindication.

Showing 21–40 of 1,158 · page 2 of 58