Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Rory Driscoll

๐Ÿ‘ค Speaker
613 total appearances

Appearances Over Time

Podcast Appearances

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

So metering that demand relative to the cost to produce is, as it were, the business challenge.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And you're seeing that across the board.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

I mean, in Entropic, you're seeing all these, yeah, their $200 plan, the $20 plan, and then they have those few people who are doing $1,000 of tokens on their $200 plan, and what do you do about that?

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

So...

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

But again, so that's what's happening out here, which is everyone's trying.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And that's if you're the model producers.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

If you're a SaaS vendor like you and I are investing in, an AI apps vendor, and inference is one of your biggest costs now.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

It used to be five years ago, AWS would be one of your biggest costs.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

It would hit 10%.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And everyone would lose their shit in the board meeting.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And you'd say, let's get it down.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And you'd manage the process and get it down to eight or nine with efficiencies.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

Now you're right.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

It's inferences.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

The big cost.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

If you're a high priced app, maybe it's 10 or 15%.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

If you're a coding type app, maybe it's 50, 60, 70% of your revenue.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

And if you don't manage that correctly, you don't have a business.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

You have the irritating habit of asking exactly the right question.

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Brex Acquired for $5.15BN | a16z Companies are 2/3 AI Revenues | Anthropic Inference Costs Skyrocket | OpenEvidence Raises at $12BN Valuation | The IPO Market: EquipmentShare, Wealthfront and Ethos Insurance

No, I totally...