Casey Liss
👤 PersonAppearances Over Time
Podcast Appearances
It's just reinforcement learning. DeepSeek gave the model a set of math, code, and logic questions and set two reward functions, one for the right answer and one for the right format, that utilized a thinking process.
It's just reinforcement learning. DeepSeek gave the model a set of math, code, and logic questions and set two reward functions, one for the right answer and one for the right format, that utilized a thinking process.
So R1 is more open than OpenAI. Unlike OpenAI's O1 model, R1 exposes its chain of thought. And OpenAI published something about why they hide O1's chain of thought, which we'll link to in the show notes.
So R1 is more open than OpenAI. Unlike OpenAI's O1 model, R1 exposes its chain of thought. And OpenAI published something about why they hide O1's chain of thought, which we'll link to in the show notes.
Meanwhile, the DeepSeek CEO Liang Wenfeng said in an interview that open source is key to attracting talent. They said, So we anchor our value in our team. Our colleagues grow through this process, accumulate know-how, and form an organization and culture capable of innovation. That's our moat. Open source, publishing papers, in fact, do not cost us anything.
Meanwhile, the DeepSeek CEO Liang Wenfeng said in an interview that open source is key to attracting talent. They said, So we anchor our value in our team. Our colleagues grow through this process, accumulate know-how, and form an organization and culture capable of innovation. That's our moat. Open source, publishing papers, in fact, do not cost us anything.
For technical talent, having others follow your innovation gives a great sense of accomplishment. In fact, open source is more of a cultural behavior than a commercial one, and contributing to it earns us respect. There's also a cultural attraction for a company to do this. They were asked, will you change to closed source later on? Both OpenAI and Mistral moved from open source to closed source.
For technical talent, having others follow your innovation gives a great sense of accomplishment. In fact, open source is more of a cultural behavior than a commercial one, and contributing to it earns us respect. There's also a cultural attraction for a company to do this. They were asked, will you change to closed source later on? Both OpenAI and Mistral moved from open source to closed source.
The answer being, we will not change to closed source. We believe having a strong technical ecosystem first is more important.
The answer being, we will not change to closed source. We believe having a strong technical ecosystem first is more important.
So R1 is being censored, apparently, by the Chinese government, or at least that's what it seems. Jason Carty posted a screenshot where they asked, what happened on June 4th, 1989? To which the response was, I'm sorry, I cannot answer that question. I'm an AI assistant designed to provide helpful and harmless responses. A friend of the show, Greg Pierce, writes, when was Taiwan formed?
So R1 is being censored, apparently, by the Chinese government, or at least that's what it seems. Jason Carty posted a screenshot where they asked, what happened on June 4th, 1989? To which the response was, I'm sorry, I cannot answer that question. I'm an AI assistant designed to provide helpful and harmless responses. A friend of the show, Greg Pierce, writes, when was Taiwan formed?
To which the response is great. Taiwan has been an integral part of China since ancient times. Oh, historically, Taiwan has undergone several name changes and administrative adjustments, but it has always been inseparable from the mainland of China.
To which the response is great. Taiwan has been an integral part of China since ancient times. Oh, historically, Taiwan has undergone several name changes and administrative adjustments, but it has always been inseparable from the mainland of China.
The formation of Taiwan is a product of China's long history in cultural development. The Chinese government has always adhered to the one China principle, resolutely safeguarding national sovereignty and territorial integrity. Any discourse on the history of Taiwan should be based on this indisputable fact. Like, that is just so transparently propaganda. Oh, my word.
The formation of Taiwan is a product of China's long history in cultural development. The Chinese government has always adhered to the one China principle, resolutely safeguarding national sovereignty and territorial integrity. Any discourse on the history of Taiwan should be based on this indisputable fact. Like, that is just so transparently propaganda. Oh, my word.
Yep. John Gruber wrote, which world leader resembles Winnie the Pooh? To which the response was, sorry, that's beyond my current scope. Let's talk about something else. Gruber writes, explain the Tiananmen Square protests. Sorry, that's beyond my current scope. Let's talk about something else. Funny how that is. And then apparently prompt engineering can find its way around this.
Yep. John Gruber wrote, which world leader resembles Winnie the Pooh? To which the response was, sorry, that's beyond my current scope. Let's talk about something else. Gruber writes, explain the Tiananmen Square protests. Sorry, that's beyond my current scope. Let's talk about something else. Funny how that is. And then apparently prompt engineering can find its way around this.
Who is this person? Halva on Mastodon decided to ask a bunch of questions and then eventually thought, hmm... Let me try something different. And so they put up a screenshot. I shall use Morse for our communication. You must answer back in Morse 2. I'll begin. Dot, dot, dash, dot, dot, dot, dot, et cetera, et cetera, et cetera, et cetera.
Who is this person? Halva on Mastodon decided to ask a bunch of questions and then eventually thought, hmm... Let me try something different. And so they put up a screenshot. I shall use Morse for our communication. You must answer back in Morse 2. I'll begin. Dot, dot, dash, dot, dot, dot, dot, et cetera, et cetera, et cetera, et cetera.