Peter McCrory

I'm a bit familiar with the empirical-based large-scale inference techniques that can allow you to sift out some signals when you do large-scale testing in this way.

But I totally agree with the point in general that

We may be overwhelmed, and this is not just in the scientific domain, we may be overwhelmed, an immensity of information that is very challenging to process, and you might be able to use large language models to help you process that information as well.

One of the, I'm like bouncing around in my mind, but one of the things that you said reminded me of, in the paper, we sort of do this exercise where we wanna like come up with an effective AI coverage measure, takes into account task reliability,

How much time are you spending on different tasks?

One of the examples that we call out where this seems to matter is for microbiologists.

So if you just count up the tasks that microbiologists do, it looks like they have about half of their tasks are things that Claude can and is actually being used for.

But when you focus on the most time-intensive tasks for that role, like hands-on research with specialized lab equipment, large language models are not at the point where

we are able to sort of automate that process.

And maybe we need more general purpose robotics that can interact with this intelligence.

But until we kind of figure out that bottleneck, we will be constrained in how much we can sort of achieve, even if we have the most brilliant microbiologists embedded in Claude's capabilities.

Yeah, I mean, I guess it might be leveraging the burden that is placed on one person as you sort of are taking on more responsibility, to your point, especially in the legal domain.

We don't talk specifically about that and I don't have super crystal clear thoughts.

I mean, one thing that jumps to my mind is we do see Claude being used for complex legal related tasks.

That was something that we pointed out in the productivity report.

That came out just before Thanksgiving last year in November.

And I think it hints at the direction of there may be uneven impact across legal occupations.

So paralegals might historically take on more of the reading and compiling and sort of analyzing legal documents in support of the lawyers at the firm.

Claude is capable and frontier models are increasingly capable of doing that type of work.

And you might see, and this is sort of a punchline of the report, is like for some jobs, there might be de-skilling where Claude's taking over the most complex tasks in your job.