Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Grant Harvey

๐Ÿ‘ค Speaker
See mentions of this person in podcasts
6491 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 2
Confidence: High

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Have you seen anything over the past year or like six months even that has lit you up in terms of like, ooh, this could be a good alternative for that memory context problem?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Or are you like, we still haven't seen anything that's even close?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Although I will say with that equation, being able to work in parallel, I think makes you maybe perhaps make those trade-offs or you can make some of those calculations more efficiently.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Would you agree with that?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

If that makes sense?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

How does this work in a Gentic context then?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

How would it be different, let's say, in something like Cloud Code, where it's going out, it's doing a bunch of tool calls, it's reasoning.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

How does it play out in that scenario, if different?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Yes.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Yes.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Um, you mentioned earlier, so like one of the, the, um, unique things and benefits of being the person who basically made this, um, uh, is that, you know, all of the tricks of how to, you know, run it and deploy it.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Um, and you know, there's a lot of frameworks that support regular LLMs, but maybe not as many frameworks or, you know, you have an in-house framework for dealing with diffusion.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Would you ever make like an open version of that?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Like, do you want everyone to go through you?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Like what, what's your, what's your business plan there?

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

I guess.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Yeah, that's fair.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

No, that's totally fair.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

I was just thinking like, you know, like in one of NVIDIA's strengths, right, is CUDA, which kind of keeps everyone locked in.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

So I was wondering if there was a similar kind of play there eventually where, you know, you make it easy for everyone to do this, but then you're still the gatekeeper in some way.