Nathan Lambert
speaker
1,013 appearances
1 recordings
1 series
first heard Nov 2024
last heard Nov 2024
Nathan Lambert’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
It's probably not worth the effort to spend all your time on preference tuning when you could just be making better data and better pipelines, which is what two through three is about, inspired by the transition we're seeing with the Llama report, with Trap Bot Arena, is like turned into a hockey stick again, where we have those incremental scores and the OpenAI and Google are like skyrocketing their scores.
And the philosophy is like,
How do we try to understand what the open groups should be doing and where there are hills to climb when you're increasing the complexity substantially of post-training?
If you can have humans and LLMs do preference data, which do you send to humans versus LLMs?
And that I think solves a lot of the problems, which is like there are definitely things that we want humans giving the answer on, but there are a lot of mechanical tasks that we can outsource LLMs.
There's a lot more at post-training.
that is not really touched.
And I think that the opportunity is high.
Because the big thing is how do you develop character?
Character is something that you don't have evaluation for in your models.
And our models, if you compare them to Claude, will not have as consistent of a character.
Yeah, thanks for having me.
The Nathan Squared pod has happened.
Yeah, so the Allen Institute, I'm new blood here.
I'm I joined it just over a year ago.
Um the institute is actually ten years old.
It was founded um it's funded by Paul Allen, which is not surprising for people in the tech scene and knowing the Allen Institute in in Seattle, given the name.
And the original CEO, Orin, I don't know how to pronounce his last name, also was a professor at UW, a lot of UW ties.
I think was Buds with Paul Allen.
And this kind of grew out of that to just kind of do um AI research for the common good, make things very open, very hybrid academic industry.
Showing 1–20 of 1,013 · page 1 of 51
Next →