Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Kieran Kunhya

πŸ‘€ Speaker
1922 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

Because cost is increasing, because we need more power.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

And so you're limited by either your CPU, your RAM, or your networking.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

And you need to optimize.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

And this is where...

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

value is going to be especially because like doing ai is going to help do the programming of like business right and so the core thing that you will not be able to vibe code are optimization for the hardware to be as fast as is possible i'd love to talk to you about who and how should learn assembly but first i think we need a bathroom break

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

There is not enough data to train on.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

And this is the biggest issue.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

I started my career actually doing some assembly for titanium, right?

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

So the titanium is a dead processor type, right?

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

Which was done by Intel and HP a long time ago when they wanted to do 64 bits.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

Well, they lost and then we got AMD who did it.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

AMD 64, which became x64.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

But Itanium was extremely interesting in the sense that those were processors who had a ton of computing power to do floats, FMAs, which is similar to what we need now for LLMs, right?

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

And you could pack three operations per line that could be loaded.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

So basically, you had an output of basically 6 billion of operation per second.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

But the bus, the memory bus only allowed 1.5, right?

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

So your CPU was four times faster.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

So you had to do crazy things to pack things in memory, reuse the registered data.

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

And those type of semantics, no language could do that, right?

Lex Fridman Podcast
#496 – FFmpeg: The Incredible Technology Behind Video on the Internet

So, like, I have the Itanium programming book because Intel did amazing books, but that's exactly what Kiran says.