Yi Tay

speaker

925 appearances 1 recordings 1 series first heard Jan 2026 last heard 23 Jan

Yi Tay’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.

newest first · ▶ plays the moment

So there's also this thing about

uh idea that it's proposed has to be compatible with all the work that have been done before to it to shine.

Right.

It's a bit of a variant of this hardware lottery like by by Sarah.

It's not the hardware lottery that I wrote about the GPUs failing, but it's the it's the original hardware lottery.

But it's more like a bit of lottery of like the things proposed have to play well with the things that were proposed before.

So it's a bit like going down this local optic minima to some extent.

So now we are like in this local minima of like

Transformers, everything, everything, right?

Maybe it's not easy to like get totally out of this because also a lot of people's investment, optimization have been have been done.

So the things that play well need to play well with the ideas.

before.

And the the way I see it now is it's very difficult to like c come out of it.

Okay, I'm not

Does this

Like mm miss

misunderstanding a little bit about like all the last five years has just been like scaling things, skills.

Okay,

but I think that ideas like matter and I think that there have been a lot of good ideas in the last five years.

It's just that maybe it's just not so it's not been like blindly like if you took an MLP, right?

Showing 541–560 of 925 · page 28 of 47