Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

George Sivulka

👤 Person
546 total appearances

Appearances Over Time

Podcast Appearances

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

So he's like, well, let's just go add some fuel to the fire. How much did he invest in? He, I think, invested like an additional $2 or $2.5 million at the time. So where did the $130 come from? Well, that was years later. This was years later? So this is all in 2020. We end up building a product studio, which is the first to productionize RAG, Retrieval Augmented Generation, also in 2020.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

So he's like, well, let's just go add some fuel to the fire. How much did he invest in? He, I think, invested like an additional $2 or $2.5 million at the time. So where did the $130 come from? Well, that was years later. This was years later? So this is all in 2020. We end up building a product studio, which is the first to productionize RAG, Retrieval Augmented Generation, also in 2020.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

We build the first semantic search engine. We actually go out and start to- Can you just help us understand what is RAG? RAG is an acronym that stands for Retrieval Augmented Generation. If you look at large language models today, they're really good at maybe thinking if you give it the right context, but they hardly ever have the right context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

We build the first semantic search engine. We actually go out and start to- Can you just help us understand what is RAG? RAG is an acronym that stands for Retrieval Augmented Generation. If you look at large language models today, they're really good at maybe thinking if you give it the right context, but they hardly ever have the right context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

We build the first semantic search engine. We actually go out and start to- Can you just help us understand what is RAG? RAG is an acronym that stands for Retrieval Augmented Generation. If you look at large language models today, they're really good at maybe thinking if you give it the right context, but they hardly ever have the right context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

And so RAG was the first real attempt to give them the data to answer questions correctly. Okay. And so we are building on RAG to start. We were one of the first people to productionize the idea of putting a search engine behind an LLM. So you'd ask a question and then instead of it just replying from its memory, it would actually go and do a search and then reply with that context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

And so RAG was the first real attempt to give them the data to answer questions correctly. Okay. And so we are building on RAG to start. We were one of the first people to productionize the idea of putting a search engine behind an LLM. So you'd ask a question and then instead of it just replying from its memory, it would actually go and do a search and then reply with that context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

And so RAG was the first real attempt to give them the data to answer questions correctly. Okay. And so we are building on RAG to start. We were one of the first people to productionize the idea of putting a search engine behind an LLM. So you'd ask a question and then instead of it just replying from its memory, it would actually go and do a search and then reply with that context.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

So in an enterprise where you have a lot of offline data, we were really the first people to hook up that offline data to large language models to answer that question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

So in an enterprise where you have a lot of offline data, we were really the first people to hook up that offline data to large language models to answer that question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

So in an enterprise where you have a lot of offline data, we were really the first people to hook up that offline data to large language models to answer that question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

That's a bit of a plot twist over here. I actually don't think RAG works at all. It's one of the most used AI architectures in the world, pioneered at Hebbia in a very meaningful way. I think every enterprise is experimenting with it, but it has a lot of different failures where a lot of the time, the questions that people ask these systems aren't ever explicitly in the data.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

That's a bit of a plot twist over here. I actually don't think RAG works at all. It's one of the most used AI architectures in the world, pioneered at Hebbia in a very meaningful way. I think every enterprise is experimenting with it, but it has a lot of different failures where a lot of the time, the questions that people ask these systems aren't ever explicitly in the data.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

That's a bit of a plot twist over here. I actually don't think RAG works at all. It's one of the most used AI architectures in the world, pioneered at Hebbia in a very meaningful way. I think every enterprise is experimenting with it, but it has a lot of different failures where a lot of the time, the questions that people ask these systems aren't ever explicitly in the data.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

They're never explicitly stated. They're actually about the data. So for example, if you're asking an AI system, is this company a good investment? which is actually a very common thing that people ask Hebbia over marketing materials. Maybe it'll say in a pitch deck, yeah, this company is a great investment as something that the CEO says or like a recording, et cetera.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

They're never explicitly stated. They're actually about the data. So for example, if you're asking an AI system, is this company a good investment? which is actually a very common thing that people ask Hebbia over marketing materials. Maybe it'll say in a pitch deck, yeah, this company is a great investment as something that the CEO says or like a recording, et cetera.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

They're never explicitly stated. They're actually about the data. So for example, if you're asking an AI system, is this company a good investment? which is actually a very common thing that people ask Hebbia over marketing materials. Maybe it'll say in a pitch deck, yeah, this company is a great investment as something that the CEO says or like a recording, et cetera.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

But what you actually want from that system isn't a search in the data, it's an answer about the data. Hey, what's the customer concentration? What's the strength of the management team? What are X, Y, or Z criteria that are fundamental to our specific investing process? And that's a process. That's not ever explicitly stated. Actually, the marketing materials are often like a load of crap.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

But what you actually want from that system isn't a search in the data, it's an answer about the data. Hey, what's the customer concentration? What's the strength of the management team? What are X, Y, or Z criteria that are fundamental to our specific investing process? And that's a process. That's not ever explicitly stated. Actually, the marketing materials are often like a load of crap.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

But what you actually want from that system isn't a search in the data, it's an answer about the data. Hey, what's the customer concentration? What's the strength of the management team? What are X, Y, or Z criteria that are fundamental to our specific investing process? And that's a process. That's not ever explicitly stated. Actually, the marketing materials are often like a load of crap.