Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jan Kulveit

👤 Speaker
279 total appearances

Appearances Over Time

Podcast Appearances

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Human memory, human attention, human survival shape which variants can exist.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

What happens when the substrate starts to change?

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

As is in my view often the case with AI risks, the first examples come as bizarre and harmless.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

In May 2024, Google's AI started suggesting that if cheese slides off your pizza, you should add glue to the sauce.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

The recommendation came from an 11-year-old Reddit joke.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

A journalist tried it, wrote about it.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

This got into training data.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Soon AIs were citing the journalist's article to recommend one-eighth cup of glue for pizza.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

There's an image here.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

The feedback loop.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

AI output.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Right arrow.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Human amplification.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Right arrow.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Training data.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Right arrow.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

AI output.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

A recipe for pizza with 1 8th cup of glue is not something humans would converge on.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Different substrate leads to different transmission characteristics, and these lead to different recipes.

LessWrong (Curated & Popular)
"Why You Don’t Believe in Xhosa Prophecies" by Jan_Kulveit

Funny and harmless for pizza.