Sam Altman

But...

I notice that I have like a visceral response to being scolded by a computer.

And I think, you know, that's a good learning from deploying or from creating a system and we can improve it.

Treating our users like adults is a thing I say very frequently inside the office.

GPT-4 has enough nuance to be able to help you explore that without...

and treat you like an adult in the process.

GPT-3, I think, just wasn't capable of getting that right.

But GPT-4, I think we can get to do this.

No, it's a lot of technical leaps in the base model.

One of the things we are good at at OpenAI is finding a lot of small wins and multiplying them together.

And each of them maybe is like a pretty big secret in some sense, but it really is the multiplicative impact of all of them.

And the detail and care we put into it that gets us these big leaps.

And then, you know, it looks like to the outside, like, oh, they just probably like did one thing to get from three to 3.5 to four.

It's like hundreds of complicated things.

So tiny little thing with the training, with the, like everything, with the data organization.

How we like collect the data, how we clean the data, how we do the training, how we do the optimizer, how we do the architect, like so many things.

I heard GPT-4 had 100 trillion.

I can't believe that this came from you.

You know, it doesn't, I don't think it matters in any serious way.

This is like, in some sense, someone said to me this morning, actually, and I was like, oh, this might be right.