Nathan Lambert

speaker

1,013 appearances 1 recordings 1 series first heard Nov 2024 last heard Nov 2024

Nathan Lambert’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

Appearances

newest first · ▶ plays the moment

"The Cognitive Revolution" · Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI · 21 Nov 2024 podcast

Because if you have archite

If you support fewer architectures, you make it much faster.

So that's like a million prompts.

Yes, for SMT.

And I think Yeah, at market prices that's what?

I wasn't expecting this number, but yeah, yeah, yeah.

I think it's reason it's reasonable.

It's ballpark that.

Like ballpark a thousand dollars. 'Cause I do think we could probably get ninety percent of the performance with half the prompts.

I think looking at our mix we have like thirty plus percent math.

We were going hard on math trying to get these numbers across.

We ended up do we did like general math eval and then we have subsets for specific subsets of math, like intermediate algebra where we weren't as good.

So we like looked at the eval and saw which micro subset was not as good and like tried to make data specifically for that.

So like we definitely you don't need all of this math eval.

So that's a good that's a good rule of thumb.

Um DPO and preference shooting we have had

Um we haven't been able to show as strongly that scaling helps, like getting more prompts in and keeps improving evals.

Showing 241–260 of 1,013 · page 13 of 51