Kevin Weil

You know, the fun thing with product decisions at that scale is any example I give, I bet there are people in the audience who are like, no, no, no, you got that one wrong.

Very few are unambiguously right.

Probably one was like ranking the Twitter feed, which was extremely controversial back in the day.

uh twitter used to be completely real time and the the most you know the thing you saw at the top of your twitter feed was the thing that was tweeted one second ago the next one was the one that was tweeted four seconds ago and if your you know spouse or your best friend happened to tweet an hour ago like yeah too bad you were never gonna see it it's gonna get totally buried um but there were a lot of people that said this is the magic of twitter how could you possibly do that you know you're becoming facebook now so that was very controversial at the time although it seemed

in some sense, like, how could you not

want, you know, you do care about different people's stuff more than other people's stuff.

How could you not want ranking if we could do it well and if we could bring the right balance of recency and everything else?

So that was one.

And I think Facebook saw the same thing when they originally put out the news feed.

You have a bunch of people that are super upset, but then the metrics tell you an incredibly positive story, like double digit positive kind of thing.

And and so, you know, and then you just you you you

you can just keep making that better and keep getting wins there.

It was interesting trying to figure out how exactly we would...

When we rolled out 01 Preview, the first reasoning model, what was the right kind of UX paradigm for a model that would not give you an immediate answer?

Like all the other previous chat models, you type in an answer or you type in a question, you basically get an answer right away.

There aren't a lot of experiences online where you have to wait like that.

And the model is doing this interesting thing with its chain of thought in the meantime.

which we didn't want to expose completely because you can distill that and basically copy our model, which for a bunch of geopolitical reasons we didn't want to have happen.

But you want to show some, so it was very interesting trying to figure out how you...

Was the model that people would go away and just pop back in whenever it was done?