Sam Altman

How much does that help them create a much better world, new science, new products, new services, whatever.

And that's the one that matters and understanding for a particular set of inputs, like how much value and utility to provide to people.

I think we are understanding that better, um,

Do we understand everything about why the model does one thing and not one other thing?

Certainly not always, but I would say we are pushing back the fog of war more and more.

It took a lot of understanding to make GPT-4, for example.

Well, you know, a funny thing about the way we're training these models is I suspect too much of the processing power, for lack of a better word, is going into...

using the model as a database instead of using the model as a reasoning engine.

The thing that's really amazing about this system is that it, for some definition of reasoning, and we could, of course, quibble about it, and there's plenty for which definitions this wouldn't be accurate, but for some definition, it can do some kind of reasoning.

And, you know, maybe like the scholars and the experts and like the armchair quarterbacks on Twitter would say, no, it can't, you're misusing the word, you're, you know, whatever, whatever.

But I think most people who have used the system would say, okay, it's doing something in this direction.

and and i think that's remarkable and the thing that's most exciting and somehow out of ingesting human knowledge it's coming up with this reasoning capability however we want to talk about that um

Now, in some senses, I think that will be additive to human wisdom.

And in some other senses, you can use GPT-4 for all kinds of things and say that it appears that there's no wisdom in here whatsoever.

Yeah, it's always tempting to anthropomorphize this stuff too much, but I also feel that way.

So two separate things going on here.

Number one, some of the things that seem like they should be obvious and easy, these models really struggle with.

So I haven't seen this particular example, but counting characters, counting words, that sort of stuff, that is hard for these models to do well the way they're architected.

That won't be very accurate.

Second, we are building in public and we are putting out technology because we think it is important for the world to get access to this early, to shape the way it's going to be developed, to help us find the good things and the bad things.