Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jason Lampkin

๐Ÿ‘ค Speaker
406 total appearances

Appearances Over Time

Podcast Appearances

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

It's easy to say it's more than an order of magnitude by the end of the year potentially.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

You know, the cost decline that we're also seeing, despite the anthropic thing, it's hard.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

The token consumption is increasing the deflation in the per token cost.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

So we've seen that improvement, I think, in anthropic to Rory's point.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And I might be getting it wrong, but we haven't seen this break point where we're catching a break.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

Maybe the margins are getting better, but we're going to keep burning more.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

So I'm waiting for the moment.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

But, you know, we've talked about memory, but ChatGBT and Claude don't have that much memory.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

If you try it, don't remember much, does it?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

It remembers this little bit.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

So I built a version of Claude over the weekend called Wren.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

You can try it at Wren, W-R-E-N, chat.ai.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

It remembers everything.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

So it never forgets anything.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And I learned a lot of things, but one of them is it's going to burn a lot of tokens.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

You want to save every chat you've ever had, every discussion over all time and reference it for years.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And what if that runs 24-7?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

Maybe I'm rambling and not answering your question, but I don't see, I just see it accelerating.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And again, my biggest concern for founders out there, especially for folks that are not quite in the top 0.01%, right?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

Especially folks in ops on their team or folks that aren't close to AI that they're mismodeling this.