Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Berber Jin

๐Ÿ‘ค Speaker
189 total appearances

Appearances Over Time

Podcast Appearances

The Journal.
OpenAI's 'Code Red' Problem

Yeah, so this is where things get a little bit dicey, right?

The Journal.
OpenAI's 'Code Red' Problem

Because OpenAI used this method and while it made the chatbot experience very delightful for a lot of people, it also kind of fueled a new problem where the model is so ingratiating and keen to please that it can almost sound a little bit creepy or unrealistic, right?

The Journal.
OpenAI's 'Code Red' Problem

Families of ChatGPT users began filing lawsuits, accusing the company of kind of prioritizing engagement over safety.

The Journal.
OpenAI's 'Code Red' Problem

And the company in October said that hundreds of thousands of ChatGPT users each week were exhibiting possible signs of mental health emergencies related to psychosis or mania.

The Journal.
OpenAI's 'Code Red' Problem

Yes, yes.

The Journal.
OpenAI's 'Code Red' Problem

And it is a small minority of users when you look at their total user count, but hundreds of thousands of people are still... A lot of people.

The Journal.
OpenAI's 'Code Red' Problem

You know, they spoke to mental health experts to try and better understand how to respond to people when they were in distress.

The Journal.
OpenAI's 'Code Red' Problem

And they also tweaked their training to make sure that these user feedback signals didn't become too powerful in influencing the development of future models.

The Journal.
OpenAI's 'Code Red' Problem

Yeah, it was a little bit of a flop.

The Journal.
OpenAI's 'Code Red' Problem

It was a little bit of a PR nightmare for OpenAI.

The Journal.
OpenAI's 'Code Red' Problem

A lot of like ChatGPT's user base were not happy.

The Journal.
OpenAI's 'Code Red' Problem

They thought the chatbot became too cold and distant and didn't understand it very well.

The Journal.
OpenAI's 'Code Red' Problem

Exactly.

The Journal.
OpenAI's 'Code Red' Problem

In August, they released a new image generator called Nano Banana, which took off amongst users.

The Journal.
OpenAI's 'Code Red' Problem

and usage of their AI app called Gemini just skyrocketed.

The Journal.
OpenAI's 'Code Red' Problem

It was almost like they had their own mini ChatGPT moment.

The Journal.
OpenAI's 'Code Red' Problem

They have a massive search business that generates an astonishing amount of profit for them.

The Journal.
OpenAI's 'Code Red' Problem

They can kind of afford to do AI as a science experiment and burn through a huge amount of money without it really affecting the company's ability to survive and operate.

The Journal.
OpenAI's 'Code Red' Problem

Exactly.