Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Bridget McCormack

๐Ÿ‘ค Speaker
562 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
The surprising case for AI judges

And that's, I think, really critical to growing trust.

Decoder with Nilay Patel
The surprising case for AI judges

I think a lot about whether the frontier models

Decoder with Nilay Patel
The surprising case for AI judges

get so good eventually that they can just do this, that you don't need an institution training and governing an agentic system in a specific kind of dispute because we move past the age of hallucinations.

Decoder with Nilay Patel
The surprising case for AI judges

It doesn't sound like that's imminent today, but I don't know if it's imminent six months from now.

Decoder with Nilay Patel
The surprising case for AI judges

I mean, I didn't know last week that agents were going to be on a subreddit talking about us.

Decoder with Nilay Patel
The surprising case for AI judges

I didn't know Malt Book was coming, right?

Decoder with Nilay Patel
The surprising case for AI judges

So you can surprise me.

Decoder with Nilay Patel
The surprising case for AI judges

For now, I think you have to have governed, transparent, audited systems so people can grow that trust.

Decoder with Nilay Patel
The surprising case for AI judges

We have a white paper.

Decoder with Nilay Patel
The surprising case for AI judges

We let an academic under the tent, John Choi, who's a law professor, but he's a technologist as well.

Decoder with Nilay Patel
The surprising case for AI judges

And we just let him under the tent to kick the tires of what we were building to be able to test how it performs against the human baseline.

Decoder with Nilay Patel
The surprising case for AI judges

And the results are excellent.

Decoder with Nilay Patel
The surprising case for AI judges

So I'm excited for folks to see that when it's all ready to go.

Decoder with Nilay Patel
The surprising case for AI judges

But, you know, it's an important question.

Decoder with Nilay Patel
The surprising case for AI judges

Again, as opposed to what?

Decoder with Nilay Patel
The surprising case for AI judges

You've met humans, right?

Decoder with Nilay Patel
The surprising case for AI judges

And you've met humans who are judges.

Decoder with Nilay Patel
The surprising case for AI judges

If you think they're getting it right every single time they make a decision, I want to introduce you to some folks.

Decoder with Nilay Patel
The surprising case for AI judges

Let me just, like, this is such a, like, anecdotal stories are kind of useless when we're trying to talk about something important like this.

Decoder with Nilay Patel
The surprising case for AI judges

But I was the chief justice of, you know, the Michigan Supreme Court.