Yi Tay

speaker

925 appearances 1 recordings 1 series first heard Jan 2026 last heard 23 Jan

Yi Tay’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.

Appearances

newest first · ▶ plays the moment

Latent Space: The AI Engineer Podcast · Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay · 23 Jan 2026 podcast

By sampling multiple world models and then finding out which one fits the data the best.

Yeah.

It is something in the latent space.

Okay, okay.

So you can for simplicity it could be just be like a transform model, between and

Yes.

No, I don't think about world models that that often.

I think because world models are just not really well defined in the first place.

But I think So don't say uh world models, but the problems is

Yeah, yeah.

So I I I think I think when it comes to like like data efficiency, I think it's more like uh unbeliever or finding ways to spend more flops per per token, right?

Because you actually basically you're if you are data bound you want higher data efficiency because you can learn more from every data point, squeeze squeeze out more points, right?

So things like that can extract more can use more flops on every token is definitely like a form of

data efficiency.

Then there's the learning algorithm, right?

Because I think there's this there's a different scaling law for like humans is this, machines this, and like dogs are this, cats are this, there's this different exponent.

Right, yeah, yeah.

That is this famous, famous, famous chart.

Uh and point one and point two are just like not entirely like different things because it could be that better architecture is actually just spending more flops per token.

So if you are you come to a

Showing 621–640 of 925 · page 32 of 47