Nathan Lambert

speaker

1,013 appearances 1 recordings 1 series first heard Nov 2024 last heard Nov 2024

Nathan Lambert’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

Appearances

newest first · ▶ plays the moment

"The Cognitive Revolution" · Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI · 21 Nov 2024 podcast

Sure it doesn't hurt them.

So there was a project that I'm not an author on, but

here.

I I really like the framing.

I think

Let's do the framing and I'll comment on results, which is a bigger problem than just the paper.

The framing is if you can have humans and LLMs do preference data, which do you send to humans versus LLMs?

And that I think solves a lot of the problems, which is like there are definitely things that we want humans giving the answer on, but there are a lot of mechanical tasks that we can outsource LLMs.

This paper

Um, is probably one of many things that will come.

I'm sure labs are doing stuff like this as well.

Um, the problem with it is like there's a lot of papers that like this that

It's like, why can't we have academic papers that show that humans are important?

So the same thing is like here we like

look at our GPO results on like a human controlled data set versus human preferences versus LLM preferences.

And they're like LLM preferences scores on the bowels are higher.

And it's like, what are we missing?

And it's like I always look at the paper and I'm like

Everything seems fine, but I disagree with your final conclusion because I feel like it's not going deep enough, but I don't know how to do the experiment to go deeper.

So that is kind of me reiterating in a different way that

Showing 761–780 of 1,013 · page 39 of 51