Micah-Hill Smith

speaker

601 appearances 1 recordings 1 series first heard Jan 2026 last heard 8 Jan

Micah-Hill Smith’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.

Appearances

newest first · ▶ plays the moment

Latent Space: The AI Engineer Podcast · Artificial Analysis: Independent LLM Evals as a Service — with George Cameron and Micah-Hill Smith · 8 Jan 2026 podcast

Great.

I mean, obviously if you're a developer or company using these things, not of a exactly as you say, it doesn't matter.

You should be looking at all the different ways that we measure intelligence.

You should be looking at our cost to run index number and the different ways of thinking about token efficiency and cost efficiency based on the list prices, because that's all that matters.

But that that that is like a on on a zone actually very interesting one, right?

That is it?

Well, th just purely that chances are the last couple of years haven't seen a dramatic scaling up in the total size of these models.

And so here's a lot of room to go up probably in total size of the models, especially with the upcoming hardware generations.

Yeah.

Each of the tasks have a whole bunch of detailed instructions, some input files for a lot of them.

It's I with within the forty-four is divided into like two hundred and twenty two to five maybe um subtasks that are the the level of that we run through the H an Acarnas.

And yeah, they're really interesting.

I will say that

It doesn't necessarily capture like all the stuff that people do at work.

No AVL is perfect.

There's always going to be more things to look at, largely because in order to make the tasks well enough to find that you can run them, they need to only have a handful of input files and very specific instructions for that task.

And so I think the easiest way to think about them are that they're like quite hard take-home exam tasks.

tasks that you might do in an interview process.

Totally.

I think the the the way that we're that we're thinking about the places where it makes sense to use an LLM as Judge approach now, like quite different to some of the early LLM as Judge stuff a couple of years ago.

Showing 321–340 of 601 · page 17 of 31