Noam Brown

speaker

1,199 appearances 1 recordings 1 series first heard Dec 2022 last heard Dec 2022

Noam Brown’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

newest first · ▶ plays the moment

We thought that diplomacy would be this incredibly difficult challenge that could easily take a decade to make an AI that could play competently.

But we felt like that was a goal worth aiming for.

Honestly, I was reluctant to work on it at first because I thought it was too far out of the realm of possibility.

I was talking to a coworker of mine, Adam Lehrer, and he was basically saying, why not aim for it?

We'll learn some interesting things along the way and maybe it'll be possible.

We decided to go for it.

I think it was the right choice considering just how much progress there was in AI and that progress has continued in the years since.

Ultimately, the problem is it's simple to quantify, right?

Like you're going to play this game with humans and you want your score on average to be as high as possible.

You know, if you can say like, I am winning more than any human alive, then you're a champion diplomacy player.

Now, ultimately, we didn't reach that.

We got to human level performance.

So we played about 40 games with real humans online.

The bot came in second out of all players that played five or more games.

So not like number one, but way, way higher than that.

Do you have a sense?

That's a great question.

And so I think...

This kind of goes into how do you measure the performance in diplomacy?

And I would argue that when you're measuring performance in a game like this, you don't actually want to measure it in games with all expert players.

Showing 821–840 of 1,199 · page 42 of 60