Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jyunmi Hatcher

👤 Speaker
1230 total appearances

Appearances Over Time

Podcast Appearances

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

They just gave the AI systems carefully written prompts, natural language instructions and said, hey, analyze this data and build us a prediction model.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So they paired the UCSF master student named Ruben Sarwal with a high school student, Victor Tarka, from Huron High School in Ann Arbor, Michigan.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

These two working with AI tools generated functioning computer code in minutes.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

The same code that would normally take experienced programmers hours or even days to write.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So, you know, this is what we've been seeing in the AI space.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Like, oh, AI, I didn't know how to code before.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Now I can, you know, I can make my own software.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Hmm.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So...

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So they stacked the AI results versus the 300 plus expert teams.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Four of the eight AI chatbots produced usable prediction models.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

And of those four, some of them matched and in certain cases actually outperformed the models built by human expert teams who had spent months on the same data.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

The entire AI powered project from the very first prompt to submitting the finished paper to a journal took six months.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

And that's in comparison to the nearly two years for the human-only version.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So six months versus two years.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Two-person team with AI versus hundreds of specialist teams without it.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Now, there is a few caveats, right?

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Half of the AI tools failed.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

Four out of the eight did not produce usable code.

The Daily AI Show
Anthropic’s Safety Rules Just Shifted

So that's a coin flip.