Micah-Hill Smith
speaker
601 appearances
1 recordings
1 series
first heard Jan 2026
last heard 8 Jan
Micah-Hill Smith’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.
Appearances
Like one of the things that we saw in the hallucination rate is that Anthropics clawed models at the the the very left-hand side here with the lowest hallucination rates out of the models that we've evaluated amnesia on
That is an
Interesting fact.
I think it probably correlates with a lot of the previously not really measured vibes stuff that people like about some of the clawed models.
Yeah, dataset public?
Is it is there a hell dot set?
There's a held out set for this one.
Um so it that we we have published a public test set, but we we've only published 10% of it.
The reason is that for this one here specifically, it would be very, very easy to um like have data contamination because it is just factual knowledge questions.
Um we will update it over time to also um prevent that.
But
We've yeah, kept most of it health out so that we can
keep it reliable for a long time.
It lets us do a bunch of really cool things, including breakdown quite granularly by topic.
And so we've got some of that disclosed on the website publicly right now.
And there's lots more coming in terms of our ability to break out very specific topics.
Yeah.
that's driven this.
Yeah.
You can uh you you can partially blame us in how we define intelligence, having until now not defined hallucination as uh negative in the way that we think about intelligence.
Showing 261–280 of 601 · page 14 of 31
← Previous
Next →