Nathan Lambert
speaker
1,013 appearances
1 recordings
1 series
first heard Nov 2024
last heard Nov 2024
Nathan Lambert’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
This is our main thing, which is like trying to like make sure the recipe translates.
So for that reason it's like kind of a basic goal is like, okay, we like in order to know you're in the right ballpark, you need to beat these people that
Are known to be pretty good.
I think I've talked it.
Like I've taught the fun thing about Llama base models and instruct is that the closed labs can also validate their pipelines on it.
So like the closed labs can take the Llama 3 base and then use their post-training and compare to the instruct model that ALAMA also released.
So hearing from some people in industry, they're also like, yeah, Llama 3 instruct was like 3.1 instruct, the latest stuff was like pretty cracked.
Like it was a pretty good post-train.
I think obviously like opening
infrastructure isn't gonna work as well in Mama based models, but
The three point one models particularly actually were very good, I think.
It's clear that there were some ways that they were rushed or trying to focus focus on systems rather than novelty.
It was mostly SFT and it was DPO.
for the Llama three point one instruct and
I know they are expanding into more things now and we're kind of by being smaller and moving fast, I think we're actually going to do some we're doing some things that I bet will look pretty similar in the llama four instruct or like a llama three point five instruct type thing.
But that's kind of like the theme is we want to beat their numbers.
We're doing similar things.
We have the advantage of being smaller.
We can be a little bit
more clever maybe, but that was the development target.
Showing 81–100 of 1,013 · page 5 of 51
← Previous
Next →