Bobby

Yeah, even with a confidence score alongside that would be really interesting. There's still challenges with that because the amount of change does not always correlate to the amount of effort you can work an entire week on finding a bug, and then you found it, and it's a one-character change. And you're so exhausted by then that your commit message says, I fixed it.

Yeah, even with a confidence score alongside that would be really interesting. There's still challenges with that because the amount of change does not always correlate to the amount of effort you can work an entire week on finding a bug, and then you found it, and it's a one-character change. And you're so exhausted by then that your commit message says, I fixed it.

or something you know and so like the llm just doesn't have much to work on boom you know if i guess if you can just say well it's fuzzy it's not going to be a percent it's better than merely measuring so did you come to my only guess would be like a culture of small diffs or a culture of you can't figure it out yeah why are they so much higher on that one metric you haven't figured it out yet

or something you know and so like the llm just doesn't have much to work on boom you know if i guess if you can just say well it's fuzzy it's not going to be a percent it's better than merely measuring so did you come to my only guess would be like a culture of small diffs or a culture of you can't figure it out yeah why are they so much higher on that one metric you haven't figured it out yet

My guess is you dig into that and you find there's some sort of scheduled pull request. That's just like changing something that should be in the database, but it's not.

My guess is you dig into that and you find there's some sort of scheduled pull request. That's just like changing something that should be in the database, but it's not.

Okay.

Okay.

Yeah, I mean, that sounds fishy right there. Like, what are the odds that they're like that close?

Yeah, I mean, that sounds fishy right there. Like, what are the odds that they're like that close?

Well, I thought, okay. It all depends on how exact it is. You know, if you have a vote... and you have 99 to one, you're like, okay, but if you have a vote and it's a hundred to zero, now you're like, there was some collusion here. Like something happened.

Well, I thought, okay. It all depends on how exact it is. You know, if you have a vote... and you have 99 to one, you're like, okay, but if you have a vote and it's a hundred to zero, now you're like, there was some collusion here. Like something happened.

Which is fair because maybe they don't, they don't know. And so they're going to look at it. I'm just saying, if it was like exactly the same, then I'd be like, there's something wrong with our system here.

Which is fair because maybe they don't, they don't know. And so they're going to look at it. I'm just saying, if it was like exactly the same, then I'd be like, there's something wrong with our system here.

I think you got someone in that org who just doesn't go to work and they just have a bot that uses their own SSH key and just does, you know, every day merges and stuff. And then you ask that person how much they merged and they went and looked at their bot and they just guessed the right answer.

I think you got someone in that org who just doesn't go to work and they just have a bot that uses their own SSH key and just does, you know, every day merges and stuff. And then you ask that person how much they merged and they went and looked at their bot and they just guessed the right answer.

You can't be a self-reported 10x dev.

You can't be a self-reported 10x dev.

Oh, what an interesting problem, though.

Oh, what an interesting problem, though.