George Hotz
👤 PersonAppearances Over Time
Podcast Appearances
Okay, to be fair, like a lot of the models we're building today are very, even RLHF is nowhere near as complex as the human loss function.
Okay, to be fair, like a lot of the models we're building today are very, even RLHF is nowhere near as complex as the human loss function.
Um, you know, when I talked about will GPT-12 be AGI, my answer is no, of course not. I mean, cross-entropy loss is never going to get you there. You need, uh, probably RL in fancy environments in order to get something that would be considered like AGI-like. So to ask like the question about like why, I don't know, like it's just some quirk of evolution, right?
Um, you know, when I talked about will GPT-12 be AGI, my answer is no, of course not. I mean, cross-entropy loss is never going to get you there. You need, uh, probably RL in fancy environments in order to get something that would be considered like AGI-like. So to ask like the question about like why, I don't know, like it's just some quirk of evolution, right?
Um, you know, when I talked about will GPT-12 be AGI, my answer is no, of course not. I mean, cross-entropy loss is never going to get you there. You need, uh, probably RL in fancy environments in order to get something that would be considered like AGI-like. So to ask like the question about like why, I don't know, like it's just some quirk of evolution, right?
I don't think there's anything particularly special about where I ended up, where humans ended up.
I don't think there's anything particularly special about where I ended up, where humans ended up.
I don't think there's anything particularly special about where I ended up, where humans ended up.
Look, actually, I don't really even like the word AGI, but general intelligence is defined to be whatever humans have.
Look, actually, I don't really even like the word AGI, but general intelligence is defined to be whatever humans have.
Look, actually, I don't really even like the word AGI, but general intelligence is defined to be whatever humans have.
If your loss function is categorical cross entropy, if your loss function is just try to maximize compression, I have a SoundCloud, I rap, and I tried to get ChatGPT to help me write raps. And the raps that it wrote sounded like YouTube comment raps. You know, you can go on any rap beat online and you can see what people put in the comments. And it's the most like mid quality rap you can find.
If your loss function is categorical cross entropy, if your loss function is just try to maximize compression, I have a SoundCloud, I rap, and I tried to get ChatGPT to help me write raps. And the raps that it wrote sounded like YouTube comment raps. You know, you can go on any rap beat online and you can see what people put in the comments. And it's the most like mid quality rap you can find.
If your loss function is categorical cross entropy, if your loss function is just try to maximize compression, I have a SoundCloud, I rap, and I tried to get ChatGPT to help me write raps. And the raps that it wrote sounded like YouTube comment raps. You know, you can go on any rap beat online and you can see what people put in the comments. And it's the most like mid quality rap you can find.
Is mid good or bad? Mid is bad. It's like mid, it's like.
Is mid good or bad? Mid is bad. It's like mid, it's like.
Is mid good or bad? Mid is bad. It's like mid, it's like.
It's like middle of the curve. There's that intelligence curve. You have the dumb guy, the smart guy, and then the mid guy. Actually, being the mid guy is the worst. The smart guy is like, I put all my money in Bitcoin.
It's like middle of the curve. There's that intelligence curve. You have the dumb guy, the smart guy, and then the mid guy. Actually, being the mid guy is the worst. The smart guy is like, I put all my money in Bitcoin.
It's like middle of the curve. There's that intelligence curve. You have the dumb guy, the smart guy, and then the mid guy. Actually, being the mid guy is the worst. The smart guy is like, I put all my money in Bitcoin.