Francois Chaubard
speaker
744 appearances
1 recordings
1 series
first heard Jul 2026
last heard 17 Jul
Francois Chaubard’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
And this is the most recent paper for the audience is LEWM, LE World Model, which is super, super great.
However, to be completely frank, the...
This is self-supervised learning.
Super great.
It doesn't work that well.
If you were to not do these techniques, and there's a bunch of other techniques that you can do, it will actually outperform much better.
Let's say, for example, if I'm going to do an LLM and you have Francois likes sushi, which is definitely true.
And I tokenize this into a bunch of different tokens here.
And this is token ID 6, 19, 28, whatever.
And I look up the encoding into this and it's going to be, uh, E one E two.
What you can actually do is have the LLM output.
The LLM will take in these things and will output the next token.
And so it would be like, let's call it H. This would be the low jets coming out of it.
T plus 1.
And what you can do is actually have this be close to ET plus 1.
And a lot of people are playing with this idea and getting rid of the cross entropy loss entirely.
And so if you were to do this, it actually as a proxy for the cross entropy loss, and there is no cross entropy loss and the cross entropy head is actually very expensive.
And so this is very cheap and like this lady just grabbing it.
So people are playing around with this idea.
Um, and as a, as a, basically as a, as a cheaper proxy for the cross entropy loss.
Showing 581–600 of 744 · page 30 of 38
← Previous
Next →