Joel Hron
👤 PersonAppearances Over Time
Podcast Appearances
But like hallucination is certainly one of the most critical aspects of it.
And I think what we find is that like each of these models are, you know, really good at different things.
Like GPT-5, really good at a lot of reasoning stuff.
Like the anthropic models are exceptional at like tool use and these sorts of activities, code writing.
the Gemini Google models are really good at longer context type tasks where you're dealing with huge documents and things like that.
And it's hard to break up the context.
And so we really find that like, you know, testing these models on a regular basis, having really good internal benchmarks that we lean on to give us
good signal as to where these models might be stronger or weaker, helps us refine our focus of where we put these models.
We also do, we acquired a company about a year ago called SafeSign that was really focused around legal small language model development.
And that's certainly an area of research for us as well.
Like, as you think about it,
Again, just the volume of raw content we have, but also the number of experts we have in this field who, again, know this legal process, know legal reasoning.
I think the ability to train some of these finer aspects into smaller models, whether those be tools or actual components and planning process, has real potential as well.
And so that's a big area of research for us at the moment, in addition to the third-party models we use.
I'm actually quite excited about it, to be honest with you.
I think, you know, in in my shoes, like as a company with terabytes of proprietary content and thousands of legal experts.
I think we have all of the ingredients to really excel with open source models.
And so as that tide rises, I think it creates a lot of opportunity for us to deliver models to our customers in different ways that help them manage the security or privacy concerns they may have.
So I think we're really optimistic about the future state of open source.
I also think sort of the positive momentum of open source drives the commercial models better.