Nathan Lambert
speaker
1,013 appearances
1 recordings
1 series
first heard Nov 2024
last heard Nov 2024
Nathan Lambert’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
And it really is like
I could look at the days.
I don't have the dates in mind.
It's like if we started this project four months ago, it's like, oh, a few months in, we pass Llama three instruct.
And then like a month and a half later we pass Llama three point one instruct to eight B.
And then like a couple of weeks later it's seventy B and it's like just metrononic and it's like only every time it's like, Oh wow, this is like actually happening.
So
It's fun it's fun to see and we're very excited to see what people build on it.
And I don't like you we might have a discussion later on, which is like fine tuning from bass versus fine tuning it from instruct, which is another kind of
There's another fork and I think fine tuning from base is very academic and very important to post training to understand how to do this from base models.
And fine tuning from instruct is a very important area, especially for new companies and domain specific things.
Because if Llama is gonna put out a very strong instruct model, you don't have to do the whole two loop three suite to make it good at your specific domain.
It's like we're doing part of this, but eventually there's gonna need to be research there.
I think on the day of recording um Nexus Flow, which is a startup that
came from
Like some of the people are from Berkeley Nest, the group that released the Starling models.
Um, they released another fine tune on instruct, and we saw Nemotron fine tune on Llama Instruct to go very viral recently.
So there is some messaging that like
we're not doing this fine tune on instruct, but it is another area.
I just think in terms of like fundamental long term ecosystem building, the from base is still the thing that needs the most transparency.
Showing 101–120 of 1,013 · page 6 of 51
← Previous
Next →