David Friedberg

The problem is that when we use our coding tools, they route through Anthropic, which is fine because Anthropic is excellent, but it's really expensive.

The difficulty that you have is that when you have all this leapfrogging, it's not easy to all of a sudden just like, you know, decide to pass all of these prompts to different LLMs because they need to be fine-tuned and engineered to kind of work in one system.

And so like the things that we do to perfect code gen or to perfect back propagation on Kimmy or on Anthropic,

You can't just hot swap it to deep speed.

All of a sudden it comes out and it's that much cheaper.

It takes some weeks, it takes some months.

So it's a complicated dance and we're always struggling as a consumer.

What do we do?

Do we just make the change and go through the pain?

Do we wait on the assumption that these other models will catch up?

To make it easier to switch between them.

This weekend, a different company with a huge model came to us and gave us the preview of their next-gen model.

And it's incredible.

But then when I sit on Monday morning with my team and I'm like, okay, what do we do?

We don't know what to do.

Do we cut it?

Do we move over and say, great, we'll refactor all these workloads to run on this new model?

It's a really hard problem, and it's getting worse the more complicated tasks that we undertake.

What is it called?

Efficient Language Models from Apple.