Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Corey Noles

👤 Person
1009 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

We're excited to have you here.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

It's an interesting time and sounds like you guys are doing some neat work.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Well, you know, so, you know, we always think about the idea that training is the hard part for these massive models.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

But you and the Samba Nova team are often talking about how inference and actually running them is the real challenge.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Can you kind of explain why that is?

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Especially dealing with products too.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

I mean, the user just has no patience or tolerance for weight on any scale.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

And, you know, I think it's interesting you talked about Volume 2 and as these things are scaling up, you know, you kept hearing these discussions for a long time about how the cost of intelligence was going down.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

And something I think they're never clear about is that, like, the cost of serving an individual unit of intelligence, for lack of a better phrase, is very cheap.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

But if you're dealing in product where you're serving to many, many people,

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

those little fractions of a penny add up in a big hurry.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Yeah.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Here's a common developer nightmare for you.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

You've finally shipped your AI agent and the transcription falls apart the second someone speaks with an accent or calls in from a noisy cafe or switches language.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Does that sound familiar?

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Thought so.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

It's not just frustrating.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

Failed calls can kill your business.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

And that's exactly why Gladia built Solaria.

The Neuron: AI Explained
AI Inference: Why Speed Matters More Than You Think (with SambaNova's Kwasi Ankomah)

It's the first speech-to-text model designed to handle the messy, real-world stuff with sub-270 millisecond latency, more than 100 languages supported, more than 200,000 other developers are already building with it today,

← Previous Page 1 of 51 Next →