Tristan Redman

Lili, olemme iloisia, että olet täällä tänään, koska se tuntuu niin, että tehtävänä on monimutkaisen tärkeästä teollisuudessa. Viime viikolla A.I.-hankkija Anthropic antoi, että aloittaa uuden A.I.-modellin. Antropik sanoi, että tämä uusi A.I. oli liian vaarallista laittaa yleisölle. Miksi tämä oli niin vaarallista?

Is Mythos only designed for this type of security usage or is it actually similar to AI tools that all of us are used to already, you know, like ChatGPT or the regular Claude?

Okei, joten käytännössä se ei ole vain erittäin vahva asia, vaan se toimii myös jonkin verran autonomiaan, joten se ei tarvitse ihmisen tietoa johtamaan sen tai lähettämään sen kautta. Se on käytännössä vain se, että käy ja hakkaa tuon vahvistuksen ja se tekee sen, miten se tehdään, itsenäisesti. Onko se oikein?

Okay, so mythos, potentially extremely powerful hacking tool. Now, Lilly, I have learned something today whilst I was reading in before our conversation, and that is the word alignment, and that mythos is potentially threatening because it is non-aligned, is that right? And essentially that means that it can be sneaky. Can you explain this to me, though, please?

There very well could be a day where we just don't have control, and so hopefully this thing will do the right thing when presented with various circumstances. But could that be as simple as a bad actor having access to an AI like this Claude Mythos, and the bad actor saying, hack that power grid that belongs to my adversary, and the AI simply declining to do it because of its learned philosophy or morality or sense of values?

Well, I find this very interesting, Lilly, because I do have at least one philosopher in my family. And I'm not sure philosophers have always felt hugely sought after in the job market, but maybe that might be changing for them. So maybe that's good news. Send them our way. The opportunities abound. I'll get them maybe to move to Silicon Valley and we'll see what happens.

Tämä ei ole vain teknologian tarina, onko se, Lilly? Tämä on myös yrityksen tarina. Emme kaikki ole vielä tuttuja näistä yrityksistä. Ne ovat suuria yrityksiä. Mikä on Anthropixin reputointi ja miten he voisivat nähdä itseään?

Joka tapauksessa, jos mitojen esitykset on uskottavissa, me saamme hetken, jolloin meillä on mahdollisesti todella vahva AI-tulko, joka on mahdollisesti hankalaa ja voisi olla vaikeampi ihmisten kontrollista. Olemme saamassa, sanotaanko, Jurassic Parkin hetkeä. Hetken, jolloin jotain ihmisten tekemistä saa huomioon ihmisen kontrollista. Onko se jotain, jota me riskitämme tällä hetkellä?

I'm delighted that you raised this, Lili, because our editor, James Shield, he won't like me mentioning his name, but I have to, because he loves Jurassic Park. And he has thoughts on this. So, I mean, he was talking about...

The dangers of owning a theme park full of velociraptors, I should say fictional dangers, of owning a theme park full of velociraptors and Tyrannosaurus rexes, is that two things can happen. One is that a malicious person can set them loose to get rich.

Stealing Velociraptors DNA and selling it off or whatever it is they decide to do. Or the dinosaurs themselves might become smart enough to detect the weaknesses in the security system, in the electric fences, and learn how to open the doors and get out themselves. Is that a helpful way to understand the security risks of an incredibly powerful AI tool like Mythos?

How worried should we be, Lily, if I'm sitting in the park having my sandwich? Could I get taken down by Mythos AI imminently?

Lili, kiitos paljon, että olit näyttänyt minulle tämän. Kiitos paljon. Se on ollut ilmoittavaa. Kiitos. Hienoa olla sinun kanssa.

That was the BBC's North America tech correspondent, Lily Jamali. And that's it for today's episode. If you're looking for the very latest breaking news from around the world, then look for our sister show, the Global News Podcast, wherever you listen. Today's episode was produced by Viv Jones and Aron Keller. It was edited by James Shield. It was mixed by Travis Evans. Our digital producer is Matt Pintus. Our senior news editor is Chyna Collins.

On pohtinut, että tulisiko mun kesäautosta niin kuin talviauto, jos en ajaisi Australiaan. Eihän tossa ole mitään järkeä.

And I'm Tristan Redman, and we're here with a bonus episode for you from the Global Story podcast.

Every day we focus on one story, looking at how America and the world shape each other.

Hei there, I'm Asma Khalid.

I'm Tristan Redman, and we're here with a bonus episode for you from the Global Story podcast. The world order is shifting. Old alliances are fraying and new ones are emerging. Some of this turbulence can be traced to decisions made in the United States. But the US isn't just a cause of the upheaval. Its politics are also a symptom of it. Every day we focus on one story, looking at how America and the world shape each other.

So we hope you enjoy this episode and to find more of our show, just search for The Global Story wherever you get your BBC podcasts. Before we start, this episode contains upsetting details of children's experiences in war. So please take care while listening. More than 1100 children have been killed or injured in the Middle East in the two weeks since the war in Iran started. That's according to UNICEF.