Nathaniel Whittemore

There's been an explosion of new ideas, initiatives, tools, and simulations as a result of anthropic employees working with highly capable models.

Far more than we have the capacity to pursue.

The rate at which organizations can spot and fix these bottlenecks may be a skill that improves over time, and it may become the most important skill for any organization.

This gets into a lot of the ideas that I've explored around the infinite backlog, and why all of a sudden I don't think we're not going to have jobs.

Aaron Levy from Box commented on this part, saying that it points to the key element of the optimistic scenario for AI.

AI, he writes, lowers the barrier dramatically to allowing us to do more.

As a result of that, we have far more ideas than we can pursue, and the ones that we want to pursue were ultimately limited by our ability to go take on the surrounding work to execute those ideas.

There's almost no amount of AI progress that can happen where that goes away.

AI is going to let us build much more software, launch more marketing campaigns, research more drugs, and so on.

All of this work, even when augmented by agents, still ultimately requires people to manage.

Now back to Anthropic, the third scenario they point to is the full recursive self-improvement scenario, where AI systems start to build their own successors.

Now this scenario is where you see the most hand waviness from Anthropic, with them just not really knowing how to guess at all the implications of this.

The final section is the one that has been jumped all over, especially by AI safety advocates.

They write, if it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing.

We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology.

But they write in the same breath, if a slowdown simply lets the least cautious actors to catch up technologically, it could leave everyone less safe.

Without a global coordination mechanism, companies and governments will have to make difficult decisions about safety while under competitive and geopolitical pressures.

They go through and talk about all that would be required for a slowdown or pause, noting that while none of it would be necessarily impossible in principle, pointing to, for example, the Intermediate-Range Nuclear Forces Treaty, quote, those regimes took decades to build both the infrastructure and the trust.

We don't have that long, they write.

A unilateral pause by one lab by contrast is achievable immediately, but accomplishes much less."