Grant Harvey
π€ SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
That's interesting.
So is that something where the, the, like, let's say like the agent builder themselves is like working with like, like your custom software to, to do that on the backend or how, like, this is very technical.
We don't have to spend much time on this, but I'm curious.
Yeah.
And is it something that you can tell the agent to do on the back end?
Like for this type of task, use this model?
Yeah, absolutely.
Is that how you put the system prompt?
That's what was blowing my mind.
Yeah, yeah, yeah.
Yeah, we just saw data.
There was an economist piece and Rohan Paul, who's like a really great AI Twitter personality, shared this.
So basically NVIDIA's Grace Blackwell chips use about 40 kilowatts for inference versus like 12 kilowatts for computing.
You can correct me if those numbers are off.
That's just what this tweet said.
And training jumps to 80 kilowatts.
So like, I guess from your perspective, how much of the energy efficiency problem is about the chips themselves versus the architecture?
Is it both?
What's your take on that?
Exactly.