Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Grant

👤 Speaker
6139 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

uh you know small or that level gemma 3n for example yeah gemma 3n like really really small models that allegedly some of which you could even run on a phone i mean how you do that i think is still a little bit people are like yeah you can in theory but we don't know how um but there was like two two things that i wanted to follow up on that uh first is the the cloud point uh there was a great take i'm forgetting who it was but i'll credit them when in the comments uh

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

who was basically saying, like, we spent all this time putting all of all of our computing to the cloud, but then it sort of like defeats the purpose of the Internet being like decentralized.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

Right.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

And that like like now all of a sudden everything is like, you know, going off to like these, you know, couple of providers and it doesn't create that resiliency.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

To your point, if like something gets hit, like does the whole eastern seaboard go down, you know, depending on where the data centers are.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

We don't know.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

So there is a very good reason to try and have as much localized compute power as possible.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

And to my earlier point, the models are also getting smaller.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

They're getting not only smaller, but better when they're smaller, which is a very exciting thing to see.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

And I think that the more that we specialize into...

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

niche models, the more that we'll see smaller models get used.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

I guess the counterpoint, though, is like, what if you do have a really niche use case that you think, you know, you don't need like incredible data, you know, gigawatt level data centers to do?

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

You can technically train your own model on like a workstation or a series of workstations.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

Great question.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

Yeah.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

Right.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

Because you only need it for that very specific case.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

Quick tangent about that.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

I wrote for a company once that was doing basically the equivalent of that, but for drones.

The Neuron: AI Explained
AI PC Buyer’s Guide: Specs That Actually Matter (ft. Dell’s Logan Lawler)

And so they have these automated drone swarms that basically can survey people.