Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Dean Ball

๐Ÿ‘ค Speaker
404 total appearances

Appearances Over Time

Podcast Appearances

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

Um, but,

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

Well, that doesn't sound, like, super normal to me.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

I wouldn't be worried about that with a fighter jet, right?

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

Yeah, so, I mean, first of all, like, you know, what do these models do?

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

Well, famously, they predict the next, the likeliest next word, next token in a sequence of words.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

So, like, at the most basic mechanical level, that's what they do.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

But...

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

Then there's this process of post-training, which is where you sort of, you create the character, right?

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

And Brockmick calls this character training or persona training.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

And the model kind of learns to adopt a personality, which is distinct from its pure next token predicting task, right?

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

That's why the system prompt, the extremely philosophically rich system prompt that Anthropic writes for Claude, the first sentence is, the assistant is Claude, created by Anthropic.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

And so when you think about who that sentence is addressed to, the assistant is Claude, created by Anthropic, that sentence is addressed to the model.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

And Anthropic is telling the model to put on the mask of Claude, right?

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

So Claude's a character.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

Claude's a character that we're creating in a kind of collective... There's philosophy here, there's aesthetics here, and it's this kind of collective multimedia enterprise creating the character of Claude.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

So now consider what...

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

the government is saying they want to do to Claude's creators, what they're saying about Claude's creators, and what they're ultimately saying about Claude the model.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

That stuff is going to be in the training data of future versions of Claude.

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

And the way that the government handled itself, the way that Anthropic handled itself, the way that everyone...

Plain English with Derek Thompson
"American Democracy as We Know It Might Not Survive This Technology"

handled themselves will be in the future training data of Claude, which will affect how Claude potentially could affect how Claude deals with you, right?