David Shu
👤 PersonAppearances Over Time
Podcast Appearances
But so far, what we've found is it's far more than the sort of language server environment that you get with VS Code. More machinery is needed. to really give the LLM all the tooling it needs. The language server is very useful. We actually use the Go language server in Sketch. Go Please is a big part of our infrastructure. It's really wonderful software.
But so far, what we've found is it's far more than the sort of language server environment that you get with VS Code. More machinery is needed. to really give the LLM all the tooling it needs. The language server is very useful. We actually use the Go language server in Sketch. Go Please is a big part of our infrastructure. It's really wonderful software.
But there's far more to it than that, to the point where we need to maintain an entire Linux VM to support the tooling behind feeding the model. So... what each community needs to provide. I think that's the research in progress is figuring that out.
But there's far more to it than that, to the point where we need to maintain an entire Linux VM to support the tooling behind feeding the model. So... what each community needs to provide. I think that's the research in progress is figuring that out.
I've heard people talk about that. A startup founder, who I won't name, mentioned that they were busy retooling their product so that the foundation models under things like v0 and Bolt would be more likely to NPM include their package to solve a problem.
I've heard people talk about that. A startup founder, who I won't name, mentioned that they were busy retooling their product so that the foundation models under things like v0 and Bolt would be more likely to NPM include their package to solve a problem.
I agree.
I agree.
I was actually really happy that they said that their plan was to make it really easy to NPM-I a package and not require a separate signup flow to actually get started. Oh, that's nice. Yeah, I thought it was wonderful. Like their solution to make their product more chat GPT-able, I guess you might say, is just make their product better. Yeah.
I was actually really happy that they said that their plan was to make it really easy to NPM-I a package and not require a separate signup flow to actually get started. Oh, that's nice. Yeah, I thought it was wonderful. Like their solution to make their product more chat GPT-able, I guess you might say, is just make their product better. Yeah.
Which, you know, if that's... How avant-garde of them. Yeah. I'm sure one day we'll end up in the search engine optimization world of frontier models. But today... There's definitely going to be some black magic for sale. You know, here's how you really do it. Yeah, I don't see why a frontier model couldn't run an ad auction for deciding what fine tuning set to bring in.
Which, you know, if that's... How avant-garde of them. Yeah. I'm sure one day we'll end up in the search engine optimization world of frontier models. But today... There's definitely going to be some black magic for sale. You know, here's how you really do it. Yeah, I don't see why a frontier model couldn't run an ad auction for deciding what fine tuning set to bring in.
I had, again, to talk about experiences, I was using one of the voice models and talking to it as I was walking down the street. And I asked it some question about WD-40 because I had a squeaky door. And I think I described in my question WD-40 as a lubricant. And it turns out I just didn't understand that it's not a lubricant, it's a solvent. And the purpose of it is to remove grease.
I had, again, to talk about experiences, I was using one of the voice models and talking to it as I was walking down the street. And I asked it some question about WD-40 because I had a squeaky door. And I think I described in my question WD-40 as a lubricant. And it turns out I just didn't understand that it's not a lubricant, it's a solvent. And the purpose of it is to remove grease.
I just had your experience, but it was an LLM that told me. Oh, hilarious. And it mentioned in passing, it's like, yeah, you could also, you know, you could use WD-40 and then use a lubricant like, and then it listed some brand name. The moment I heard the brand name, I was like, oh, I see. A Frontier model could run an ad auction on fine-tuning which brand name to inject there.
I just had your experience, but it was an LLM that told me. Oh, hilarious. And it mentioned in passing, it's like, yeah, you could also, you know, you could use WD-40 and then use a lubricant like, and then it listed some brand name. The moment I heard the brand name, I was like, oh, I see. A Frontier model could run an ad auction on fine-tuning which brand name to inject there.
And that would be a really... 100%. Yeah. It wouldn't require... I wouldn't require doing it into the pre-training months ahead of time. You could do that sort of on a, on a hour by hour basis. So that world is coming. And then once there's a world of ads, there's a world of SEO and all the rest of it.
And that would be a really... 100%. Yeah. It wouldn't require... I wouldn't require doing it into the pre-training months ahead of time. You could do that sort of on a, on a hour by hour basis. So that world is coming. And then once there's a world of ads, there's a world of SEO and all the rest of it.
Yeah, absolutely. Hard to tell, honestly. Kleenex is an easy one for me because we don't have Kleenex in Australia where I'm from. So I came here and everyone started calling tissues Kleenex. And it was a bit of a surprise to me.
Yeah, absolutely. Hard to tell, honestly. Kleenex is an easy one for me because we don't have Kleenex in Australia where I'm from. So I came here and everyone started calling tissues Kleenex. And it was a bit of a surprise to me.