Pavan Agarwal
👤 PersonAppearances Over Time
Podcast Appearances
Why did ChatGPT suddenly come to the scene and other similar, and I noticed you have some llamas out there, and that was llama 3.3, I think. So why did ChatGPT become, why was it even possible?
Why did ChatGPT suddenly come to the scene and other similar, and I noticed you have some llamas out there, and that was llama 3.3, I think. So why did ChatGPT become, why was it even possible?
and a lot of people don't realize that that the real breakthrough didn't come from open ai the real breakthrough came from a paper that google published in i think 2015 and it's called attention is all you need okay and that was a breakthrough in how to do um
and a lot of people don't realize that that the real breakthrough didn't come from open ai the real breakthrough came from a paper that google published in i think 2015 and it's called attention is all you need okay and that was a breakthrough in how to do um
how to do language processing specifically but i think in general applies to most um most complex problems um that an ai could have would have to deal with and it it cut out most of the overhead of processing a large a large amount of data.
how to do language processing specifically but i think in general applies to most um most complex problems um that an ai could have would have to deal with and it it cut out most of the overhead of processing a large a large amount of data.
And so, with that breakthrough paper and then OpenAI applied it extensively and then created, you know, ChatGPT 1, 2, and then 3, and 3 was actually good enough for, to capture the imagination of the larger market. And so, it took that final Like, packaging of this science has been developing for so many years.
And so, with that breakthrough paper and then OpenAI applied it extensively and then created, you know, ChatGPT 1, 2, and then 3, and 3 was actually good enough for, to capture the imagination of the larger market. And so, it took that final Like, packaging of this science has been developing for so many years.
I mean, if you think about 2015, the paper comes out, and it was, what, 2020, 2021, when Chachi PD 3.0 came to the scene, right? Look how long it takes. You know, technology doesn't happen overnight. It feels, when you're the consumer of it, you suddenly see, oh, there's a new thing called Chachi PD. No, it was... It takes a long process. Before, it's actually relatable.
I mean, if you think about 2015, the paper comes out, and it was, what, 2020, 2021, when Chachi PD 3.0 came to the scene, right? Look how long it takes. You know, technology doesn't happen overnight. It feels, when you're the consumer of it, you suddenly see, oh, there's a new thing called Chachi PD. No, it was... It takes a long process. Before, it's actually relatable.
When you can take science and make it relatable where people can understand it in an everyday way, it's a big investment. Just like with Bitcoin. You know, I mean, that's the paper, original Satoshi. Before Satoshi paper, there was another paper that defined the whole idea of decentralized ledgers. And then that one failed. There was another coin that came out and failed in the end.
When you can take science and make it relatable where people can understand it in an everyday way, it's a big investment. Just like with Bitcoin. You know, I mean, that's the paper, original Satoshi. Before Satoshi paper, there was another paper that defined the whole idea of decentralized ledgers. And then that one failed. There was another coin that came out and failed in the end.
And then Bitcoin came out, right? I mean, this is 20 plus years in the making. Right. It doesn't happen overnight.
And then Bitcoin came out, right? I mean, this is 20 plus years in the making. Right. It doesn't happen overnight.
Well, actually, I invest a lot of my money in real estate. I love real estate. Because remember what I said in the beginning, we grew up as kids cleaning houses and buying, mostly buying and sometimes selling, but mostly buying and holding. Nice. And there's a few times where I looked at whether you owned a property, I said, this property is too much trouble and I sold it.
Well, actually, I invest a lot of my money in real estate. I love real estate. Because remember what I said in the beginning, we grew up as kids cleaning houses and buying, mostly buying and sometimes selling, but mostly buying and holding. Nice. And there's a few times where I looked at whether you owned a property, I said, this property is too much trouble and I sold it.
And I went back and I said, I never should have sold it. Never should have sold it.
And I went back and I said, I never should have sold it. Never should have sold it.
Yeah, I mean, we were in the mortgage business in 2008 when home prices in California fell 50%, 60%, right? And I remember you go through Laguna, Laguna Niguel, Laguna Hills, right? And those million dollar, $2 million homes were selling for $600,000. Wow. And people were walking away from their mortgages.
Yeah, I mean, we were in the mortgage business in 2008 when home prices in California fell 50%, 60%, right? And I remember you go through Laguna, Laguna Niguel, Laguna Hills, right? And those million dollar, $2 million homes were selling for $600,000. Wow. And people were walking away from their mortgages.