Mike Stonebraker
๐ค SpeakerAppearances Over Time
Podcast Appearances
Then you do it all again, and you do this like three or four times.
So that doesn't parallelize well.
So the answer is indexing doesn't parallelize well.
Query optimizer.
It's tough, it's just,
algorithmically difficult.
It's still, if you ask most any senior database programmer what's the hardest part, they'll still say the optimizer.
there were a lot of not very enlightened people who said, Google is really smart.
They must know what they're doing.
And so we'll do whatever they say.
And so they would engage in Hadoop or engage with Hadoop.
But Hadoop is ridiculously inefficient.
And so at the time,
others, Dave DeWitt and others who were involved in our 2011 paper.
We understood distributed databases and understood that you could beat the heck out of Hadoop with a distributed database system, which is basically what that 2011 paper says.
And of course, it's true.
But that wasn't the only thing Google was stupid about.
So Google also had the opinion that eventual consistency was the right way to do concurrency control.
And so that was postulated from on high by Google all during that same period of time.
And all the database people said, you're out of your frigging mind because it solves one particular kind of problem, and that very rarely occurs in practice.