Karen Hao
👤 SpeakerAppearances Over Time
Podcast Appearances
It can't
literally focus on advancing all types of capabilities.
They have to actually set their mind to advancing a certain by gathering the data that is needed for that capability by taking, you know, getting a bunch of human contractors to annotate and train the model to do that exact thing.
And so scaling these models is actually a perpendicular question to are we actually getting
more cyber capabilities specifically and more military capabilities specifically.
And again, it's back to his hypothesis about how human intelligence works and what the appropriate model of the brain is.
His hypothesis throughout his career has been the brain is a statistical engine.
But that's his hypothesis and that is not...
universally agreed upon, especially among people that are not in the AI world.
When you talk with neuroscientists and psychologists, people who actually study human intelligence in the human brain, that is where you start to get a lot of debate and disagreement about this particular view that Hinton has.
And so this is kind of like one of the things.
It's like AI...
is already being used in the military and has been used in the military for a long time.
But specifically accelerating large language models
isn't just the only path for getting military capability.
Like, the companies would have to choose to specifically pick military capabilities to accelerate, not just, like, general intelligence.
It's like, you know what I'm saying?
Like, they create this myth that they are actually pushing the frontier of all of the capabilities of the model, but that's not what's actually happening internally.
And I have... I had hundreds of pages of documents on, like, how they were specifically training models.
They pick...