Sam Altman

Like here's the level of intelligence you can expect.

I'll say it's way more scientific than I ever would have dared to imagine.

Like any new branch of science, we're going to discover new things that don't fit the data and have to come up with better explanations.

And that is the ongoing process of discovering science.

But with what we know now, even what we had in that GPT-4 blog post, I think we should all just be in awe of how amazing it is that we can even predict to this current level.

Well, there's all these different evals that we could talk about.

And... What's an eval?

Oh, like how we measure a model as we're training it, after we've trained it, and say like, you know, how good is this at some set of tasks?

Yeah, I think that'll be really helpful.

But the one that really matters is...

and we pour all of this effort and money and time into this thing.

And then what it comes out with, like how useful is that to people?

How much delight does that bring people?

How much does that help them create a much better world, new science, new products, new services, whatever.

And that's the one that matters and understanding for a particular set of inputs, like how much value and utility to provide to people.

I think we are understanding that better, um,

Do we understand everything about why the model does one thing and not one other thing?

Certainly not always, but I would say we are pushing back the fog of war more and more.

It took a lot of understanding to make GPT-4, for example.

Well, you know, a funny thing about the way we're training these models is I suspect too much of the processing power, for lack of a better word, is going into...