Dario Amodei

We've spoken up in favour of sensible AI regulation and export controls that are in the public interest, even when these are at odds with government policy.

Many people have told me that we should stop doing this, that it could lead to unfavourable treatment, but in the year we've been doing it, Anthropic's valuation has increased by over 6x, an almost unprecedented jump at our commercial scale.

Second, the AI industry needs a healthier relationship with government, one based on substantive policy engagement rather than political alignment.

Our choice to engage on policy substance rather than politics is sometimes read as a tactical error or failure to read the room rather than a principled decision, and that framing concerns me.

In a healthy democracy, companies should be able to advocate for good policy for its own sake.

Related to this, a public backlash against AI is brewing.

This could be a corrective, but it's currently unfocused.

Much of it targets issues that aren't actually problems, like data center water usage, and proposes solutions, like data center bans or poorly designed wealth taxes, that wouldn't address the real concerns.

The underlying issue that deserves attention is ensuring that AI development remains accountable to the public interest, not captured by any particular political or commercial alliance, and it seems important to focus the public discussion there.

Third, the macroeconomic interventions I described earlier in this section, as well as a resurgence of private philanthropy, can help to balance the economic scales, addressing both the job displacement and concentration of economic power problems at once.

We should look to the history of our country here.

Even in the Gilded Age, industrialists such as Rockefeller and Carnegie felt a strong obligation to society at large, a feeling that society had contributed enormously to their success and they needed to give back.

That spirit seems to be increasingly missing today, and I think it is a large part of the way out of this economic dilemma.

Those who are at the forefront of AI's economic boom should be willing to give away both their wealth and their power.

Black Seas of Infinity Subheading Indirect Effects This last section is a catch-all for unknown unknowns, particularly things that could go wrong as an indirect result of positive advances in AI and the resulting acceleration of science and technology in general.

Suppose we address all the risks described so far and begin to reap the benefits of AI.

We will likely get a century of scientific and economic progress compressed into a decade, and this will be hugely positive for the world, but we will then have to contend with the problems that arise from this rapid rate of progress, and those problems may come at us fast.

We may also encounter other risks that occur indirectly as a consequence of AI progress and are hard to anticipate in advance.

By the nature of unknown unknowns it is impossible to make an exhaustive list, but I'll list three possible concerns as illustrative examples for what we should be watching for.

Rapid advances in biology.