Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Mark Blyth

๐Ÿ‘ค Speaker
435 total appearances

Appearances Over Time

Podcast Appearances

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

I would just love to start because you have done some work in the cryptocurrency field, done a lot of work in the crypto field. I'd just love to start before we dive in deep on infrastructure. How does the AI hype today compare to Bitcoin hype? How is it the same and how is it different?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

I do want to ask, and we'll start with kind of the hardest question of all, but it's the most important, and you've written about this, and I loved your piece.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

I do want to ask, and we'll start with kind of the hardest question of all, but it's the most important, and you've written about this, and I loved your piece.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

I do want to ask, and we'll start with kind of the hardest question of all, but it's the most important, and you've written about this, and I loved your piece.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

The kind of core question that everyone's asking right now is, does more compute equal an increased level of performance, or have we reached a point where it is misaligned and more compute will not create that significant spike in performance? Kevin Scott at Microsoft says, absolutely, we have a lot more room to run.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

The kind of core question that everyone's asking right now is, does more compute equal an increased level of performance, or have we reached a point where it is misaligned and more compute will not create that significant spike in performance? Kevin Scott at Microsoft says, absolutely, we have a lot more room to run.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

The kind of core question that everyone's asking right now is, does more compute equal an increased level of performance, or have we reached a point where it is misaligned and more compute will not create that significant spike in performance? Kevin Scott at Microsoft says, absolutely, we have a lot more room to run.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

Why are you skeptical, and have we gotten to a stage of diminishing returns on compute?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

Why are you skeptical, and have we gotten to a stage of diminishing returns on compute?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

Why are you skeptical, and have we gotten to a stage of diminishing returns on compute?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

MARK BLYTH, Can we just take them one by one there? There was a lot of great things that I just want to unpack. You said there about kind of potentially the shortage of data being the bottleneck to performance.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

MARK BLYTH, Can we just take them one by one there? There was a lot of great things that I just want to unpack. You said there about kind of potentially the shortage of data being the bottleneck to performance.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

MARK BLYTH, Can we just take them one by one there? There was a lot of great things that I just want to unpack. You said there about kind of potentially the shortage of data being the bottleneck to performance.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

A lot of people say, well, there's a lot of data that we haven't mined yet, which the obvious example that many have suggested is kind of YouTube, which has obviously, I think, 150 billion hours of video. And then secondarily to that, synthetic data, the creation of artificial data that isn't in existence yet. To what extent are those effective pushbacks?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

A lot of people say, well, there's a lot of data that we haven't mined yet, which the obvious example that many have suggested is kind of YouTube, which has obviously, I think, 150 billion hours of video. And then secondarily to that, synthetic data, the creation of artificial data that isn't in existence yet. To what extent are those effective pushbacks?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

A lot of people say, well, there's a lot of data that we haven't mined yet, which the obvious example that many have suggested is kind of YouTube, which has obviously, I think, 150 billion hours of video. And then secondarily to that, synthetic data, the creation of artificial data that isn't in existence yet. To what extent are those effective pushbacks?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

What about the creation of new data that doesn't exist yet?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

What about the creation of new data that doesn't exist yet?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

What about the creation of new data that doesn't exist yet?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

While we're on utility value of data, when we look at effectiveness of agents, I've had Alex Wang at Scale.ai on the show, and he said the hardest thing about building effective agents is most of the work that one does in an organization, you don't actually codify down in data. You remember when you were at school and it says, show your thinking or show your work.