Peter McCrory

But, you know, we have alternative evidence as well.

And so we're still in the early stages.

A quick note.

So I think I'll sort of respond to this through the lens of one of the primitives that we introduced.

And it was sort of to try to get at this idea where we asked,

how many, you know, ask Claude effectively to estimate how many years of formal education would someone need to have to understand the prompt?

And how many years of formal education would you need to understand Claude's response?

It turns out that

the most complex sort of high education tasks in our data typically coincide with very sophisticated prompts provided by the human.

So I think in my example that I mentioned before, where I'm asking Claude to do this regression analysis and somewhat sophisticated implementation,

At present, you need a PhD in economics to understand and formulate and have the taste to know how to prompt the model and much less evaluate the output that it produces.

And so there is this question of like,

What's the best way to acquire those skills?

There is evidence on this front that it's not just acquiring the skill, but it's also developing the cognitive endurance.

A shout out to one of my good friends at University of Chicago, Christina Brown, has a nice paper on this front in a developing world educational context.

That's a really great question.

And, you know, maybe I'll have a harder time sort of concretely pointing to something here at Anthropic, but I do believe that it is exactly as you're describing that

to have the taste and discernment of what is good writing, you need to spend a lot of time actually writing.

And so I would encourage someone to not

let Claude take the first pass at a draft.