Rohin Shah
speaker
1,071 appearances
1 recordings
1 series
first heard Jun 2026
last heard 2 Jun
Rohin Shah’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jun 2026 with 1.
Appearances
grading that is based on stuff that doesn't actually matter is something that we wouldn't actually stand behind as mattering for actual safety.
This feels like the sort of thing that causes people to be, that causes like the culture overall to be looking at costs or inputs rather than actual outcomes that matter.
And results in incentives to appear good, to look good, to like make sure your comms say, you know, we spent a thousand hours figuring out what to do with this model when maybe those thousand hours were like, you know, we like...
ran the model on an input, and we looked at it, and then we ignored the result because it didn't matter, and we, like, you know, hired some contractors to do this and just ignored what they said.
But now we can say that we spent 1,000 hours looking at it.
I'm like, I don't want these incentives.
They seem bad.
It seems...
bad for transparency and candidness.
I like to the more that, uh, Google or anyone else, any other company is doing this, the less I'm able to like say, you know, what it is that I think actually matters for safety.
The more I have to, you know, do this like complicated dance of, um, saying the things that will appease the people who want us to be, you know,
who want us to be showing commitment to putting in resources into a problem.
And the less I can be like, here's the stuff we're doing that actually matters for safety, and here's why I think it's good.
It's just a poor incentive landscape overall.
And I think it's really quite important to me that we don't fall into the trap of looking good rather than just actually being good and then justifying why that's the case.
Yeah, I think there is some substantial truth to this.
Certainly for the purpose of like building on the research, it is good to have details.
And I think that's why we publish papers.
Do we need to do this in the model card or the frontier safety report?
I've gone around talking to policy and governance people especially about this, and I ask them, what do you actually use our model card and frontier safety report for?
Showing 541–560 of 1,071 · page 28 of 54
← Previous
Next →