Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Mike Krieger

👤 Speaker
633 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

The joke I do is, like, the CSV version is, like, yeah, I can eyeball a column of numbers and give you, like, my average. It's probably not going to be perfectly right. So I'd rather, like, use the, you know, average function. So that's on the data front.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

The joke I do is, like, the CSV version is, like, yeah, I can eyeball a column of numbers and give you, like, my average. It's probably not going to be perfectly right. So I'd rather, like, use the, you know, average function. So that's on the data front.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

On the citations front, the app that has done this most well recently, I have no affiliation with this other than, like, we listen to her parenting advice all the time. Which is, like, Dr. Becky, who's, like, a parenting guru, has a new app out. And I really like that. playing with chat apps because I really try to push them.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

On the citations front, the app that has done this most well recently, I have no affiliation with this other than, like, we listen to her parenting advice all the time. Which is, like, Dr. Becky, who's, like, a parenting guru, has a new app out. And I really like that. playing with chat apps because I really try to push them.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

On the citations front, the app that has done this most well recently, I have no affiliation with this other than, like, we listen to her parenting advice all the time. Which is, like, Dr. Becky, who's, like, a parenting guru, has a new app out. And I really like that. playing with chat apps because I really try to push them.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

And I push this one so hard around trying to hallucinate or talk about something I wasn't familiar with. And I have to go talk to the maker. They're actually... ping them on Twitter, they do a great job of like, if it's not super confident that that information is in its sort of retrieval window, it will just refuse to answer and it won't confabulate it, it won't go there.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

And I push this one so hard around trying to hallucinate or talk about something I wasn't familiar with. And I have to go talk to the maker. They're actually... ping them on Twitter, they do a great job of like, if it's not super confident that that information is in its sort of retrieval window, it will just refuse to answer and it won't confabulate it, it won't go there.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

And I push this one so hard around trying to hallucinate or talk about something I wasn't familiar with. And I have to go talk to the maker. They're actually... ping them on Twitter, they do a great job of like, if it's not super confident that that information is in its sort of retrieval window, it will just refuse to answer and it won't confabulate it, it won't go there.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

And I think that that is an answer as well, which is like the combination of model intelligence plus data, plus the right like prompting and retrieval so that like you don't want it to answer unless there actually is something grounded in the context window helps tremendously on that hallucination front. Does it cure it? Probably not. But I would say that all of us make mistakes.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

And I think that that is an answer as well, which is like the combination of model intelligence plus data, plus the right like prompting and retrieval so that like you don't want it to answer unless there actually is something grounded in the context window helps tremendously on that hallucination front. Does it cure it? Probably not. But I would say that all of us make mistakes.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

And I think that that is an answer as well, which is like the combination of model intelligence plus data, plus the right like prompting and retrieval so that like you don't want it to answer unless there actually is something grounded in the context window helps tremendously on that hallucination front. Does it cure it? Probably not. But I would say that all of us make mistakes.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

Hopefully, they're predictably shaped mistakes so you can be in like, oh, danger zone, talking outside of our piece there. I even like the idea of even having some almost syntax highlighting for like, this is rounded from my context. This is from my model knowledge. This is out of distribution, like Danger Will Robinson.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

Hopefully, they're predictably shaped mistakes so you can be in like, oh, danger zone, talking outside of our piece there. I even like the idea of even having some almost syntax highlighting for like, this is rounded from my context. This is from my model knowledge. This is out of distribution, like Danger Will Robinson.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

Hopefully, they're predictably shaped mistakes so you can be in like, oh, danger zone, talking outside of our piece there. I even like the idea of even having some almost syntax highlighting for like, this is rounded from my context. This is from my model knowledge. This is out of distribution, like Danger Will Robinson.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

I'm not sure if this is exactly where I'm like, I'm not exactly sure what I'm talking about. Maybe there's something there.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

I'm not sure if this is exactly where I'm like, I'm not exactly sure what I'm talking about. Maybe there's something there.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

I'm not sure if this is exactly where I'm like, I'm not exactly sure what I'm talking about. Maybe there's something there.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

It's a huge adjustment. I'm an engineer at heart. I like determinism in general. We had an insane issue at Instagram that we eventually tracked down to using non-EZC RAM and literal cosmic rays were flipping RAM. When you get to that, you're like, I want to rely on my hardware. It was actually a moment maybe four weeks into this role where I was like, okay, I can see the perils and potentials.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

It's a huge adjustment. I'm an engineer at heart. I like determinism in general. We had an insane issue at Instagram that we eventually tracked down to using non-EZC RAM and literal cosmic rays were flipping RAM. When you get to that, you're like, I want to rely on my hardware. It was actually a moment maybe four weeks into this role where I was like, okay, I can see the perils and potentials.

Decoder with Nilay Patel
Anthropic’s Mike Krieger wants to build AI products that are worth the hype

It's a huge adjustment. I'm an engineer at heart. I like determinism in general. We had an insane issue at Instagram that we eventually tracked down to using non-EZC RAM and literal cosmic rays were flipping RAM. When you get to that, you're like, I want to rely on my hardware. It was actually a moment maybe four weeks into this role where I was like, okay, I can see the perils and potentials.