Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jeremiah

๐Ÿ‘ค Speaker
1129 total appearances

Appearances Over Time

Podcast Appearances

Astral Codex Ten Podcast
SOTA On Bay Area House Party

It's easy enough to code a non-sycophantic AI.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

I thought it was more of a market problem.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

People like sycophantic assistants.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

That's close to right, but there are important subtleties here.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

People like AIs that tell them they're right, but they hate knowing the AI is only saying they're right because it's sycophantic.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

They want an AI that genuinely agrees with them.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

How do you make that into a startup?

Astral Codex Ten Podcast
SOTA On Bay Area House Party

Pretty easily.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

You generate a thousand AIs with a thousand different random personalities.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

Your query goes to a router AI and it matches you with the randomly generated AI closest to your opinion.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

Then that AI tells you you're right and that your ideas are great.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

How's that better than normal AI sycophancy?

Astral Codex Ten Podcast
SOTA On Bay Area House Party

Everyone is against sycophantic AIs, but also everyone surrounds themselves with friends who agree with them on almost everything.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

Here we are at a Bay Area house party, discussing each other's AI startups, when the overwhelming majority of people in the world would hate us.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

We're stealing their jobs, or filling the world with slop, or... He briefly looks around to make sure Andy Masley isn't listening in.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

Wasting water.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

And none of that bothers us at all, because we think those people are dumb and don't count, because all of our friends who we talk to at parties agree that our ideas are good.

Astral Codex Ten Podcast
SOTA On Bay Area House Party

So why is it any worse if the overwhelming majority of AIs hate your idea, but we send you to a virtual party with the one who agrees with you?