Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Stefano Ermon

๐Ÿ‘ค Speaker
359 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Let's make the models faster, faster, faster, because that really improves the user experience.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

It's a good question.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

It's something that we've thought a lot about before.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

I mean, a lot of the team is very academic.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

A lot of us have been researchers, have been publishing everything we do in our labs, and we see a lot of value in sort of like

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

you know, sharing our ideas and having a community of researchers that work together to improve and make progress.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

I think the constraint is that, as you know, it's an extremely competitive kind of landscape at the moment.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

IP, it's still a big mode.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

It's still an important kind of part of the company.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

And, you know, we feel like it would be hard for other labs to reproduce what we have.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

And so, unfortunately, open sourcing anything would reveal probably quite a bit about how the market works.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

You got to keep your advantage.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

No, and that would also be like, I think a lot of value, just like, you know, if we could open source something, just get the contributions from the community, get feedback.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

I think there would be a lot of value if we could do it.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

So that's why we thought about it a lot and we'd love to do it at some point.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Maybe when the team becomes bigger and maybe there is a way to release a smaller model or some more like a research type model that people can play with and make improvements.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

And I mean, I'm sure there is a lot to be invented and it'd be good, you know, if the whole community works towards making the fusion language models become the default.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

for the next generation of others.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

Yeah.

The Neuron: AI Explained
Diffusion for Text: Why Mercury Could Make LLMs 10x Faster

That's right.