David Shu

And the point you're making, Adam, that people often don't even realize all the great things you can do with it is true. And I'm sure a tool that helps people explore what they could do would have some effect on revenue. In terms of the technical side of it and the challenges, there are several challenges. In the very broad sense, the biggest challenge with LLMs is just the enormous amount of

And the point you're making, Adam, that people often don't even realize all the great things you can do with it is true. And I'm sure a tool that helps people explore what they could do would have some effect on revenue. In terms of the technical side of it and the challenges, there are several challenges. In the very broad sense, the biggest challenge with LLMs is just the enormous amount of

what you might call traditional non-model engineering has to happen out the front of them to make them work well. It's surprisingly involved. I can talk to some things I've been working on over the last year to give you a sense of that. Beyond that, the second sort of big technical challenge is one of sort of Tailscale's core design principles is all of the networking is end-to-end encrypted. And

what you might call traditional non-model engineering has to happen out the front of them to make them work well. It's surprisingly involved. I can talk to some things I've been working on over the last year to give you a sense of that. Beyond that, the second sort of big technical challenge is one of sort of Tailscale's core design principles is all of the networking is end-to-end encrypted. And

The main thing an LLM needs to give you insight is a source of data. And the major source of data would be what is happening on your network, what talks to what, how does it all work. And that means that any model telling you how you could change your networking layout or give you insight into what you could do would need access to data that we as a company don't have and don't want.

The main thing an LLM needs to give you insight is a source of data. And the major source of data would be what is happening on your network, what talks to what, how does it all work. And that means that any model telling you how you could change your networking layout or give you insight into what you could do would need access to data that we as a company don't have and don't want.

And so we're back to it would have to be a product you run locally. and have complete control over, which is absolutely, you know, my favorite sorts of products are that, you know, I like open source software that I can see the source code for, compile myself, run locally. That's how I like all things to be.

And so we're back to it would have to be a product you run locally. and have complete control over, which is absolutely, you know, my favorite sorts of products are that, you know, I like open source software that I can see the source code for, compile myself, run locally. That's how I like all things to be.

Trying to get there with LLMs in the state they are today is actually, I think, pretty tricky. I don't think I've seen an actually shipped product that does that really well for people. There's one. There's a developer tool that I hear a lot of good talk about that... I don't... I'm just trying to live search for it for you. Nope, that's the wrong one.

Trying to get there with LLMs in the state they are today is actually, I think, pretty tricky. I don't think I've seen an actually shipped product that does that really well for people. There's one. There's a developer tool that I hear a lot of good talk about that... I don't... I'm just trying to live search for it for you. Nope, that's the wrong one.

That's Magic Shell History, which also sounds really cool. I should use that one. Is that A2N? A2N, yeah. That one's awesome. Oh, you've used it? Oh, great. I'm a daily user.

That's Magic Shell History, which also sounds really cool. I should use that one. Is that A2N? A2N, yeah. That one's awesome. Oh, you've used it? Oh, great. I'm a daily user.

Yeah, I thought that was the only one. There's another one that is... in the sort of agent space for developers as they're writing programs. And it helps you, it's, it's like a local Claude effectively. And it's, it's primarily built around helping you construct prompts really carefully for existing open models. And I've, it's come up several times and I'm sorry, it's fallen out of my head.

Yeah, I thought that was the only one. There's another one that is... in the sort of agent space for developers as they're writing programs. And it helps you, it's, it's like a local Claude effectively. And it's, it's primarily built around helping you construct prompts really carefully for existing open models. And I've, it's come up several times and I'm sorry, it's fallen out of my head.

I will look it up later.

I will look it up later.

But it's, I hear very positive things about it. And that, that's the closest I've seen to sort of a shipped completely local product that does that sort of thing.

But it's, I hear very positive things about it. And that, that's the closest I've seen to sort of a shipped completely local product that does that sort of thing.

On which models to use, I think given the state of models that exist today, open models, the major shipped open models are so amazing that it always makes sense to start with one of those models, if nothing else, as a pre-trained base for anything that's happening. Building a model from scratch is a very significant undertaking. And I don't think is necessary for most tasks.

On which models to use, I think given the state of models that exist today, open models, the major shipped open models are so amazing that it always makes sense to start with one of those models, if nothing else, as a pre-trained base for anything that's happening. Building a model from scratch is a very significant undertaking. And I don't think is necessary for most tasks.