Janet Egan
π€ SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
So there's that.
What isn't yet as developed is like, how do you actually use those components to make verifiable claims?
But there's also another aspect here of compute providers themselves using telemetry from chips and how they're being used to say, okay, this cluster was used for training versus running inference.
And that, again, is another area of science that like initial research starts to show that, yeah, just looking at the temelotree, not even touching the data that's underneath it, you can start to get indications of what a cluster is being used for.
Signals from how the chip is being used that isn't the data inside the chip.
Yeah, so examples might be how much energy, how active the chip is, the runtime of the chip, the usage of the chip.
So initial research is showing that you can start to differentiate between maybe not training GPT-6, but training and running inference.
Right now, the chips that are shipping in the world have the capacity that if the person using the chip wants to attest a claim, a positive claim about something, they can often do that.
Yes.
Yeah, I think this is the hard part where a lot of this comes down to, and this is similar to the nuclear approach as well, is accounting.
You've got to say how much is not declared or unaccounted for.
And that's what also happens with nuclear stockpiles as well.
I think the difficulty here is that there's already probably a lot of compute in the world that isn't
clearly identifiable and isn't tracked.
And I think there's a few different ways you can approach this.
So the first is that there's a bunch of organizations thinking about what are retrofittable devices that you could add into data centers that are
not on the chip itself, but sit next to the chip that can guarantee what a data center or data center cluster is doing.
And so data centers at the moment are quite easy to identify from space.
I think that might slowly change as the UAE shifts towards maybe thinking about building underground because of like...
threats from the geopolitical environment in their region.