Oly Sourbut

And that would be like the really extreme end of agency where maybe this thing is self-sustaining in some way.

I mean, maybe it's even replicating.

I mean, these kinds of scenarios can get, I guess, I mean, scary.

And yeah, so moving along that, maybe it's not even one axis either, but I'm kind of painting as if it's one axis.

Certainly moving along that axis,

things get, the stakes get higher, the capacity for oversight goes down, and hopefully people are going to make the right trade-offs about where to kind of be on that axis.

So let's think about deep research.

That's kind of an agentic workflow.

You're kicking off an agent.

It's a kind of contained agent.

It has various affordances for search primarily, but also to kind of do sequential search and kind of perform searches on the basis of findings it's already made.

You've got various other kinds of limited agents.

People use agents for coding.

They often have access to some kind of sandbox code environment.

They're able to make edits to files.

They're able to maybe pull from APIs.

They're able to load libraries and so on.

This is another kind of somewhat contained agent.

And then maybe the oversight you have there is, in principle, you could look at every single commit it's made and every single edit it's made.

But in practice, you're probably not going to.