Peter McCrory
speaker
628 appearances
3 recordings
3 series
first heard Jan 2026
last heard 19 Jun
Peter McCrory’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 3 in all, peaking in Jun 2026 with 1.
Appearances
So we're trying to understand the impact of our decisions on these broader societal and economic outcomes that we care about.
And then using that
to inform some of the decisions that we actually make.
So I'll briefly say something about how we've shifted some of our hiring practices concretely.
I think before Cloud Code, you might ask an economist to do some of the data work in an assessment kind of live, like download the data, run the regressions, do the analysis by hand.
And then you might eventually let them use AI to do all of that work.
But we've needed to increasingly shift our
our strategy of evaluation away from, can you implement the work even with AI to, do you know how to delegate and direct the model in a somewhat messy environment?
And can you evaluate the quality of the work maybe by like looking at a PR?
Well, I don't know if I'll give the example of the most advanced form of usage, but I'll give an anecdote of my experience using Claude, where I wanted to run this cross-state regression.
I can't remember exactly what it was.
And I wanted to do it, a pooled cross-sectional regression.
So looking at what happened in 2010,
24, 2023 and going all the way back to pre-pandemic.
I remember asking Claude to go out and download the data from the Census Bureau, from the Bureau of Labor Statistics, et cetera.
And there was this very unexpected quirk where the model couldn't access data from before 2019 and just would not surface that mistake.
And I would ask it multiple times, like, no, don't hard code numbers, because it sort of had this unexpected failure mode where it said, oh, I know what those numbers were.
And it just like...
from sort of training data populated the data set.
And you might not always be attuned unless you're sort of, you have this tacit knowledge about like, does it pass a sniff test when you run the analysis?
Showing 81–100 of 628 · page 5 of 32
← Previous
Next →