Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Andy Halliday

👤 Speaker
3893 total appearances

Appearances Over Time

Podcast Appearances

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

I mean, yeah.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

That's a big corpus there.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

Yeah, I want to weave off of Google, but moving over to the chip space.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

So Google has been building tensor processing units, TPUs, not GPUs, that are focused on AI inference and AI training.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

Well, they just announced their seventh generation tensor processing unit, which they call Ironwood, named after the band that Jude Simmons and I are in.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

It's called Ironwood.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

uh anyway no that's not real but actually that part is real and i live on a street so anyway you'll never forget ironwood because ironwood is the name of this new tpu just like uh you know ruben was the name for the the chip set that nvidia moved for they have names for them plus designations well this one is a kind of an nvidia killer so here i want to give you some stats on this thing

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

So it delivers 4,600 teraflops of performance and has 192 gigabytes of HBM3E memory.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

That's I'm sure a very good memory.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

So it has a bandwidth of 7.4 terabytes per second.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

So this is a massive speed of acceleration for AI.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

And importantly,

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

Unlike the NVIDIA GB300, right, their Blackwell series, they can bang all of these together up to 9,200 accelerators coupled together to create, here's the comparison, to create a data center basically for AI inference and training that can do 42 and a half exaflops

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

of training and inference, which is far beyond what the GB300 system, the NVL72 system from NVIDIA can do, which is just one third of an exaflop.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

So compare 42 and a half exaflops to one third of an exaflop.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

So the Blackwell GB300 has just been far surpassed in terms of design for a massive acceleration.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

But you got to believe that NVIDIA has got the next generation in the hopper, right?

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

But anyway, Google is right there and maybe even passing up NVIDIA with their TPUs.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

That's crazy.

The Daily AI Show
Elon’s $1T Package, Google’s Gemini Update, and AI Fluency at Work

Was it your bros who gave you that name?