Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Yoko Li

πŸ‘€ Speaker
68 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 1
Confidence: Medium

Appearances Over Time

Podcast Appearances

The a16z Show
AI, Design, and the Power of Open Models

And to Justine's point, like exactly, like what is the implication for the professional use cases?

The a16z Show
AI, Design, and the Power of Open Models

Like what, like was the JSON prompting, what can they do more easily now with this capability compared to before?

The a16z Show
AI, Design, and the Power of Open Models

And then...

The a16z Show
AI, Design, and the Power of Open Models

I guess one thing we were always wondering is that this release, the open source model is so small.

The a16z Show
AI, Design, and the Power of Open Models

It's 9.3 billion parameters.

The a16z Show
AI, Design, and the Power of Open Models

You know, like previously, a SOTA is probably like 80 billion parameters.

The a16z Show
AI, Design, and the Power of Open Models

It's like 9x of a difference.

The a16z Show
AI, Design, and the Power of Open Models

And you can't run it on a single GPU instead of having a lot of compute footprint, which really opened up opportunity for people to use it.

The a16z Show
AI, Design, and the Power of Open Models

So the question is, how did you do it?

The a16z Show
AI, Design, and the Power of Open Models

I imagine because it's a smaller model, as you mentioned, like it's harder to win on scaling and counting number of chips, but it is possible to win on a specific domain or optimizing for a different, you know, thing in a different domain.

The a16z Show
AI, Design, and the Power of Open Models

So what was the trade-off for the research team when training this model to decide what to focus on?

The a16z Show
AI, Design, and the Power of Open Models

For enterprises, as you alluded to, I mean, customization is really top of mind, whether that's a brand kit or it's something that is stylistically just done, but hard to encode that style into just a doc.

The a16z Show
AI, Design, and the Power of Open Models

So I imagine customization on top of an open source model is just the best way to go.

The a16z Show
AI, Design, and the Power of Open Models

So the question becomes like, what is the ramp up for the customers or the artists to start, you know, post-training or fine-tuning on top of the ideal brand model?

The a16z Show
AI, Design, and the Power of Open Models

What do they have to do?

The a16z Show
AI, Design, and the Power of Open Models

With the JSON prompting and editing and model fine-tuning, the composability aspect of the model is just huge.

The a16z Show
AI, Design, and the Power of Open Models

There are so many ways you could customize it.

The a16z Show
AI, Design, and the Power of Open Models

One hot topic in the industry, in the research community, is a genetic loop for creative tools, right?

The a16z Show
AI, Design, and the Power of Open Models

So it used to be the creativity tools, the consumption layer is always a UI.

The a16z Show
AI, Design, and the Power of Open Models

As a human, I look at it and then I make modification.