Sam Altman

I don't know how much reasoning is going to turn out to be a super generalizable thing. I suspect it will, but that's more just like an intuition and a hope, and it would be nice if it worked out that way. I don't know if that's like...

There's so many ways where that could go. Maybe it trains a literal model for it, or maybe it just knows the one big model. It can go pick what other training data it needs and ask a question and then update on that.

There's so many ways where that could go. Maybe it trains a literal model for it, or maybe it just knows the one big model. It can go pick what other training data it needs and ask a question and then update on that.

You know, there's like a version of this. I think you can like... already see. When you were talking about biology and these complicated networks of systems, the reason I was smiling, I got super sick recently, and I'm mostly better now, but it was just like, body got beat up, one system at a time. You can really tell, okay, it's this cascading thing, and

You know, there's like a version of this. I think you can like... already see. When you were talking about biology and these complicated networks of systems, the reason I was smiling, I got super sick recently, and I'm mostly better now, but it was just like, body got beat up, one system at a time. You can really tell, okay, it's this cascading thing, and

And that reminded me of you talking about biology is just these, you have no idea how much these systems interact with each other until things start going wrong. And that was sort of interesting to see. But I was using ChatGPT to try to figure out what was happening, whatever, and would say, well, I'm unsure of this one thing. And then I just posted a paper

And that reminded me of you talking about biology is just these, you have no idea how much these systems interact with each other until things start going wrong. And that was sort of interesting to see. But I was using ChatGPT to try to figure out what was happening, whatever, and would say, well, I'm unsure of this one thing. And then I just posted a paper

on it without even reading the paper, like in the context. And it says, oh, that was the thing I wasn't sure of. Like now I think this instead. So there's like a, that was like a small version of what you're talking about, where you can like, can say this, I don't know this thing. And you can put more information. You don't retrain the model, you're just adding it to the context here.

on it without even reading the paper, like in the context. And it says, oh, that was the thing I wasn't sure of. Like now I think this instead. So there's like a, that was like a small version of what you're talking about, where you can like, can say this, I don't know this thing. And you can put more information. You don't retrain the model, you're just adding it to the context here.

Yeah, so my... On the general thing first, my... You clearly will need specialized simulators, connectors, pieces of data, whatever. But my intuition, and again, I don't have this like backed up with science. My intuition would be if we can figure out the core of generalized reasoning, connecting that to new problem domains in the same way that humans are generalized reasoners.

Yeah, so my... On the general thing first, my... You clearly will need specialized simulators, connectors, pieces of data, whatever. But my intuition, and again, I don't have this like backed up with science. My intuition would be if we can figure out the core of generalized reasoning, connecting that to new problem domains in the same way that humans are generalized reasoners.

would, I think, be doable.

would, I think, be doable.

But yeah, Sora does not start with a language model. That's a model that is customized to do video. And so we're clearly not at that world yet.

But yeah, Sora does not start with a language model. That's a model that is customized to do video. And so we're clearly not at that world yet.

Yeah, I mean, one example of this is like, okay, you know, as far as I know, all the best text models in the world are still autoregressive models, and the best image and video models are diffusion models. That's like sort of strange in some sense.

Yeah, I mean, one example of this is like, okay, you know, as far as I know, all the best text models in the world are still autoregressive models, and the best image and video models are diffusion models. That's like sort of strange in some sense.

So I think it's very different for different kinds of, I mean, look, on unfair use, I think we have a very reasonable position under the current law, but I think AI is so different that for things like art, we'll need to think about them in different ways. I would say if you go read a bunch of math on the internet and learn how to do math, that I think seems unobjectionable to most people.

So I think it's very different for different kinds of, I mean, look, on unfair use, I think we have a very reasonable position under the current law, but I think AI is so different that for things like art, we'll need to think about them in different ways. I would say if you go read a bunch of math on the internet and learn how to do math, that I think seems unobjectionable to most people.

And then there's another set of people who might have a different opinion. Well, what if you like Actually, let me not get into that, just in the interest of not making this answer too long. So I think there's one category people are like, okay, there's generalized human knowledge.