Ramez Naam

speaker
373 appearances 1 recordings 1 series first heard Jul 2026 last heard 16 Jul

Ramez Naam’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months
1 · Jul OctJan 26AprJulnow

Recordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.

Appearances

newest first · ▶ plays the moment
Coding is a little bit more messy.
The requirements for coding are still spoken in natural language.
But you can at least tell, did it compile?
Did it work?
How fast did it run?
And so on.
But other things like, write me a novel, or run my company,
or figure out the right foreign policy decisions for the US and Iran.
Those are incredibly messy.
You don't have a way to judge quickly in a million simulations that I get the right answer or the wrong answer.
And so it's just much harder to produce this totally formal, totally precise, and nearly limitless amount of verified training data, which is what makes AIs truly superhuman.
Great question and super insightful.
So up until a few years ago, all of the work was just training on the internet and books and papers and so on.
But a lot of the gains are coming from synthetic data and reinforcement learning, right?
So pre-training is what consumes all of this massive amount of text.
And then we do, even in pre-training, we put in synthetic data.
Like a simple example is you find some code example in one language, you translate it into every other programming language that exists, and you make that additional synthetic data that goes in.
Or you solve a bunch of math problems that you know you can solve formally.
You train on that data.
And then reinforcement learning takes that further.
Showing 261–280 of 373 · page 14 of 19 ← Previous Next →