Benedict Evans

Right.

Or you can go and download the Common Crawl from AWS.

Right.

There is this sort of like people parody of like the like suddenly magically this thing grows and becomes amazing and learns everything.

I don't think we're at that stage now.

I don't think anyone really knows when it would happen.

So it's very sort of impressionistic.

I think another answer might be you kind of have to be very careful looking at headlines and thinking like, what exactly is that telling me?

So Anthropic has done a bunch of things where they say like the AI was threatening to blackmail me.

And you read the story and you think, OK, you asked what's basically a story generating machine.

Please tell me a story of what you would do if in this situation where most people would probably say X and the machine says probably X. And you say, my God, it said it would do X. It's like, well, yeah.

It would blackmail.

It would blackmail you.

OK, how would it do that?

Yeah.

What do you mean it would blackmail you?

It's kind of like the reductio ad absurdum of this is you write, this is a point somebody else made, that like you write murder is good on a piece of paper and you put it in a photocopier and you press go and you say, oh, my God, the machine says murder is good.

Well, no, you told the machine to say that.

And that's what these anthropic studies are.

They're basically you tell the machine to say a thing and then it says it.