Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Rob Wiblin

πŸ‘€ Speaker
3881 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 1
Confidence: Medium

Appearances Over Time

Podcast Appearances

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

It's widely understood that enterprise tech deployments often take years to show bottom line impacts, even if they're going quite well.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

And notice that by this standard, an AI project that merely breaks even, that's a failure.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

A project that has benefited the company in some way that hasn't yet markedly affected productivity or profits?

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

Failure.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

And a project that's on track to be profitable next year but isn't yet?

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

Equally, a failure.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

Do you get the sense that maybe these authors would prefer to find that these projects aren't working?

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

Well, we'll come back to that.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

But another key thing to keep in mind is that these projects were running on 2024 AI models, the ones that couldn't figure out that a marble in a cup would fall out if you turned the cup upside down.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

AI was just hot garbage back then compared to what we have access to today.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

that a quarter of projects could easily turn a profit with models like that is actually kind of remarkable, if it is true.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

But we haven't even gotten to the weirdest thing about how the study's results were described, because all the numbers we've been talking about so far refer exclusively to custom, task-specific AIs that companies develop or procure for some specific narrow use case.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

that's not the most common or indeed the best way to use artificial intelligence.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

Most of us just use ChatGPT or Claude or Gemini to get our work done faster or do it to a higher level of quality.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

And indeed, the report found that staff at over 90% of companies surveyed regularly use generative AI for their work tasks, in many cases, multiple times a day.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

So the headline result should actually be that a quarter of custom applications of AI rapidly turn a profit and that almost all workers at the company surveyed are using personal AI tools somewhere between regularly and constantly.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

For some reason, the report is decidedly unimpressed by these uses of AI and makes the comment that these tools primarily enhance individual productivity, not profit and loss performance.

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

I may not be a tenured professor of business, but if your staff are each individually more productive, doesn't that mean that you can sell more products while hiring less staff, at least if you're managing your organization at all competently?

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

Wouldn't that provide some sort of opportunity to improve your profitability?

80,000 Hours Podcast
"AI doesn't work" – the story behind the stat that misled millions

I mean, giving a delivery driver a faster van only enhances individual delivery speed, but does that mean that faster deliveries wouldn't impact a company's bottom line?