Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Andy Halliday

πŸ‘€ Speaker
8318 total appearances

Appearances Over Time

Podcast Appearances

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

Because you're not activating every single, you know, perceptron in the network every single time.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

You're saying, okay, we've identified that this area over here is expert in this area and this query relates to that.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

So we're only going to activate that area.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

And we have eight such areas in our model and we only activate, you know, up to two of them at any one time.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

in response to any one query.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

But that's what they were talking about.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

But now add conversation across those in reasoning models, which has just been observed.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

And this team at the University of Chicago is focused on trying to understand what's happening to get to reasoning.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

And now they're saying, okay, it's not just that there are different areas of representation inside the model, but they're talking to each other.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

They're talking to each other without it being directed to do so.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

There's a term that's used for this issue, which is called capability overhang.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

Like AI's capabilities are way out ahead of where people are using it.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

So that's the capability overhang.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

And how do we take advantage of that?

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

Well, you really have to learn what the capabilities of AI systems are.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

And, you know, I would argue that, Carl, you're really in the vanguard of that.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

You're finding application of AI using a very up-to-the-moment understanding of what the range of capabilities are of various tools, not just one.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

And you're finding real applications of that at the edge of where it's actually been demonstrated before.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

Yeah.

The Daily AI Show
Super Bowl AI Ads and the Signal Beneath the Noise

Shall we wrap it?