Alpin Yukseloglu
๐ค SpeakerAppearances Over Time
Podcast Appearances
Whereas unverifiable stuff, it's like you don't know, there's no test.
You don't know if you got it right or wrong.
So it's like, are you good at writing a poem?
Is your joke funny?
Like these are very difficult for the models to get good at.
And if you were to just take the whole universe of code
and look at which pocket was the most verifiable, you probably would end up with a pocket that's almost entirely crypto, right?
The whole substrate is based on the concept of being verifiable, which means that with very little data, even though there isn't that much in the form of contracts, there isn't that much in the form of like, no crypto people are in these labs generally, or very few.
The models have gotten extremely good because it's so verifiable.
And also just as the models get better, like, for example, Gemini famously learned an entire language just in context.
So as the models get better, you know, the amount of data you need might be lower.
So I think the general trend and trajectory of, you know, these models are going to get extremely good at crypto extremely fast.
I think we can bet on that.
Yeah.
Yeah.
Practically, it means we collected all of the historical fund draining critical bugs from open audit contests like Coderino.
So the bugs that are found are not like, oh, you know, you have the small issue where maybe like someone could have frozen the contract for a day or something like that.
It's much more you could have strained money from this contract if you found this bug.
And the 20% initially or less than 20% initially meant that if you took a frontier model and you put in front of it all of the hardest audit problems after its knowledge cut off,
it would not be able to find the vast majority of them.