Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Ajeya Cotra

๐Ÿ‘ค Speaker
626 total appearances

Appearances Over Time

Podcast Appearances

Astral Codex Ten Podcast
What Happened With Bio Anchors?

We'll be making use of them here.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Crocs found that Kotra and Davidson underestimated annual growth in effective compute.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Here's a table.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

It shows different factors and the Kotra, Davidson and Epic slash Crocs estimates.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

So for willingness to spend, it's Kotra 1.4, Davidson 1.6 and Epic Crocs 1.7.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Cost per flop, 1.3, 1.1 and 1.4.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Training run length, only Epic and Crocs have provided an estimate, it's 1.5.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Real compute, it's 1.8, 1.8 and 3.6.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

And algorithmic progress, 1.3, 1.3 and 3.0.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

For total effective compute, Kotra's estimate 2.4, Davidson 2.3, and Epic Crocs 10.7.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Scott captions this, Epic Crocs are current best estimates, and can probably fairly be read as the real answer in quotes, against which Kotra and Davidson's earlier guesses should be judged.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

All numbers are yearly multiples, so 1.4 means that willingness to spend grows 1.4 times per year, that is 40%.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Willingness to spend.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

How much money are companies willing to spend on AI, in the form of chips and data centers?

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Dollars per flop.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

How quickly do Moore's Law, economies of scale, and other factors bring down the price of AI compute?

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Training run length.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

How long are companies spending on AI training runs for frontier models, instead of using those chips for smaller models, experiments, or consumer services?

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Real compute.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

The product of the three parameters above.