Francois Chaubard

speaker

744 appearances 1 recordings 1 series first heard Jul 2026 last heard 17 Jul

Francois Chaubard’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.

Appearances

newest first · ▶ plays the moment

Y Combinator Startup Podcast · World Models, Explained · 17 Jul 2026 podcast

This is our architecture.

And now once we train this thing, we do an insane,

insanely expensive task of test time planning.

And so this trend in RL is just called test time planning.

And a specific algorithm they use here for this is Monte Carlo research.

MCTS.

And so this is one of the possible things that you could do.

It ends up working extremely well if you have small action spaces.

Yep, so I'll take this ST.

This will give me 361 numbers that sum to one.

And so I'll have some probability of where these things are going to go, of where my opponent will play.

um here so these are like the sets of actions yeah so i'm here so that i have all my st plus ones i'll have 361 of these things um and then to be clear this is like action one action two all the way to action yeah 61. exactly yeah and the um

have to estimate the value of each one of these and so then we have to invoke the model all 361 times to give me values for each one of these things and then i will select i'll select it based on the the ucb the upper confidence bound which is this equation that is roughly something like um balancing uh

my value function of st plus one, which they're going to in the literature would be called the Q value, because it's actually

The difference between a value function and a Q value is just that I have the action as well.

So it would be ST and AT.

So we'll just call that Q value, which is my exploitation term.

And then my exploration term will be something like this funky square root of N. So it's the argmax of A of my Q.

And then I have this, which is the probability of this, this move being played, which we have from here of, of s, let's just call it st plus one.

And then I have this term, which is this sum over ns

Showing 281–300 of 744 · page 15 of 38