Francois Chaubard

speaker

744 appearances 1 recordings 1 series first heard Jul 2026 last heard 17 Jul

Francois Chaubard’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.

Appearances

newest first · ▶ plays the moment

Y Combinator Startup Podcast · World Models, Explained · 17 Jul 2026 podcast

And so this is called, that is called a world action model where some of the issues here is one, there's all these training dynamics that these things are just disparate training on different sets and things like that.

The other issue is plainly obvious.

What I have to do to actually do test time planning is I'll have to sample my, with model one, invoke theta, and then I'll,

pass that sampled action into here and then roll it out to st plus one and it's very expensive and it's a very not real time two major issues and why like why can't we just scale up alpha go to like solve all the problems um is because it's because of this property if i have one invocation to the model and it gives me both here's the action i should take and here's the st plus one that'll end up much much cheaper and much much faster

All right, so let's go through a couple examples of problems that we want to apply reinforcement learning to.

So chess is a pretty easy one.

There's an 8 by 8 grid.

And so typically when you approach any RL problem, you're going to look at star.

And so this, this, the size of the state, uh, the number of states I can be in.

So if I have these eight here and these eight says eight, 1632, so it'd be 32 to the 64.

Yes.

Quite large.

Then my transition function is stochastic and non-differentiable because you can.

You don't know what the other player is going to do.

So if I'm like in playing chess.com at my house, I move and then something happens and it comes back and then now you moved and the board has changed.

So I can't really differentiate through what the other player is doing.

The card in my action space is actually quite small.

Even though there's 32 pieces and all that stuff, there's only eight possible moves in expectation that are legit moves.

Let's just say in the beginning, I can move all my pawns.

Showing 181–200 of 744 · page 10 of 38