Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jyunmi Hatcher

👤 Speaker
1230 total appearances

Appearances Over Time

Podcast Appearances

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

This is, of course, where AI comes in, right?

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So normally, without the assistive AI, you'd have to have a whole team of experienced data scientists to just build the code pipeline before you can even look for patterns or notice anything that's significant in the data.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

And then you have to build the analysis tools.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

And so there's lots of bottlenecks through that traditional process.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So a few years ago, UCSF, they tried to solve these bottlenecks by crowdsourcing.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So they launched something called the DREAM Challenge.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

And that stands for Dialogue on Reverse Engineering Assessment and Methods.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So pretty much they come up with the acronym first and then fit what words are going to make the acronym.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

It's basically a global competition where data science teams from around the world compete to build the best prediction models.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Over 300 teams participated and then more than 100 groups submitted models trying to predict preterm birth from the data.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Most teams finished their analysis within about three months.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So here's the thing.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

It took nearly two years to pull all those results together, validate everything and actually publish the findings.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Two years from competition to publish paper.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Now, here's the AI experiment part.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So, of course, research asked what the obvious next question is.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Can AI do this faster?

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So this is what they did.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

They took eight different generative AI chatbots, think chat GPT kind of things, and gave them the exact same data sets from those dream challenges.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

No human coding.