Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

episode

Machine Learning Street Talk (MLST) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from Machine Learning Street Talk (MLST)

VAEs Are Energy-Based Models? [Dr. Jeff Beck] 46 min · 25 Jan 2026

Abstraction & Idealization: AI's Plato Problem [Mazviita Chirimuuta] 53 min · 23 Jan 2026

Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION] 42 min · 23 Jan 2026

Adversarial Examples and Data Modelling - Andrew Ilyas (MIT) 1h 28m · 22 Aug 2024

All episodes from Machine Learning Street Talk (MLST) →

Report any issue

Source

Recorded13 Jul 2026

Publisheranchor.fm ↗

Handlerec:19275574

Show notes

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstBritain's most capable coding model can't be exported, and that ban is the whole reason Cosine set out to build one from scratch. Alistair Pullen, CEO and co-founder of Cosine, sits down with Tim Scarfe to explain how a frontier system he calls Fable, locked behind US export controls, became the founding case for a UK sovereign model trained on the Isambard supercomputer in Bristol.The bet underneath it is economic. Pullen argues that an inference company, rather than a training-first lab, doesn't need billions to compete: millions, a national compute allocation, and a consortium feedback loop can be enough. From there it gets into the machinery, why open-weight models still trail the frontier on size, active parameters and data, the mixture-of-experts versus dense trade-off and why active params dominate how a model actually feels, and the edge that real coding trajectories confer.The back half is about making agents trustworthy. Pullen makes the case for beating "slop" by rewarding the process instead of the final answer, reframes code review as runtime proof (spin the bug up in a VM and force the agent to actually exploit it), and walks through Swarm, Cosine's system running hundreds of sub-agents in one shot. It ends on why memory is still an unsolved hack, how synthetic graders let you run RL on tasks with no built-in test, and why Pullen reads US export controls as an accidental gift, with a supply-chain sting in the tail.---TIMESTAMPS:00:00:00 The sovereign mandate and the Fable ban00:04:02 Millions vs billions: the inference-company model00:07:19 The consortium feedback loop00:07:40 Why open models lag the frontier00:14:59 MoE vs dense, and why active params matter00:16:29 Trajectories: the process-data advantage00:19:48 Beating slop: reward the process, not the answer00:26:06 Reusable abstractions and the epistemic wall00:29:56 Code review becomes runtime proof00:37:32 Do agentic harnesses still matter?00:40:35 Swarm: orchestrating hundreds of sub-agents00:45:14 Why memory is still unsolved00:48:25 Synthetic data and graders for RL00:53:09 The US export gift and supply-chain risk---REFERENCES:organization:[00:01:15] Cosinehttps://cosine.sh[00:04:14] Mistral AIhttps://mistral.ai[00:05:50] Anthropichttps://www.anthropic.com[00:07:42] Coherehttps://cohere.com[00:08:36] DeepSeekhttps://www.deepseek.comtool:[00:02:52] Isambard-AIhttps://isambard.ac.uk[00:05:56] Colossus (xAI)https://en.wikipedia.org/wiki/Colossus_(supercomputer)[00:07:52] GLM (Z.ai)https://z.ai[00:11:52] NVIDIA B300https://www.nvidia.com/en-us/data-center/dgx-b300/[00:15:37] gpt-oss-120bhttps://huggingface.co/openai/gpt-oss-120b[00:15:52] Devstral 2https://mistral.ai/news/devstral[00:16:01] Llama 70bhttps://www.llama.com[00:17:05] Claude Codehttps://www.anthropic.com/claude-code[00:26:23] ARC-AGI (Francois Chollet)https://arcprize.org[00:40:38] Swarm (Cosine)https://cosine.sh[00:40:50] OpenAI Codexhttps://github.com/openai/codex[00:41:16] Lumen Outpost (Cosine)https://cosine.sh[00:41:18] Kimi K2 (Moonshot)https://huggingface.co/moonshotai/Kimi-K2-Instruct[00:49:55] SWE-benchhttps://www.swebench.com[00:52:40] SystemVeriloghttps://en.wikipedia.org/wiki/SystemVerilogperson:[00:23:40] Andrej Karpathyhttps://karpathy.aipaper:[00:27:10] GRPO (DeepSeekMath)https://arxiv.org/abs/2402.03300[00:27:13] GSPOhttps://arxiv.org/abs/2507.18071Incompressible Knowledge Probes, Bojie Lihttps://arxiv.org/pdf/2604.24827Estimating the Size of Claude Opus 4.5/4.6https://unexcitedneurons.substack.com/p/estimating-the-size-of-claude-opus---ReScript:https://app.rescript.info/session/5852d2b884c4ce4b?share=10b9799160845bb11779f8ac6cd3124f

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.