Dwarkesh Patel
speaker
19,288 appearances
62 recordings
3 series
first heard Feb 2024
last heard 17 Sep
Dwarkesh Patel’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 27 in all, peaking in Jun 2026 with 6.
Appearances
The differences we see between different groups of people, especially if this group of people, 50,000 to 100,000 years ago, had a very small population size.
I think last time we were discussing on the order of 10,000 people.
So basically...
everybody in the world, or almost everybody in the world, or the variance we see between different humans today, was latent in this group, which sort of seems... And I get your point that, well, if you just stack up different things across the genome, then stacking them up really has a big effect.
But it's interesting that we have so many different groups in the world today, and all that diversity...
It comes from very small population size.
Fruso has an amazing ML infra team that keeps finding clever ways to squeeze more performance out of their hardware.
For example, tokenization has become a real bottleneck for agentic workloads.
Agentic prompts are often extremely long.
They tend to have high KV cache rate rates, which shrinks the GPU's pre-fill work.
This means that the tokenization step,
which is traditionally sequential, is a much larger fraction of time-to-first token.
To solve this, Crusoe built FastTokens, an open-source Rust-based tokenizer which parallelizes things in order to take advantage of all the cores on modern CPUs.
Crusoe had to get creative here because the naive approach doesn't work.
For example, for pre-tokenization,
You can't just split your text into chunks and run regex, because you'd end up with issues whenever a word straddled the split.
Crusoe solved this by giving each thread an authority zone, plus the ability to read one kilobyte past its own edges.
This one kilobyte buffer guarantees that you won't misprocess a token,
And the Authority Zone guarantees that you won't end up with duplicates.
No cross-thread coordination required.
Showing 4221–4240 of 19,288 · page 212 of 965
← Previous
Next →