Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Narrator (TYPE III AUDIO)

👤 Speaker
266 total appearances

Appearances Over Time

Podcast Appearances

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

My guess is when the rest of the world behaves as if you were this older person, it shapes your sense of self and identity, particularly if others around you believe your mind can change substrates like that.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Perhaps recognising your past acts may be similar to an individual with amnesia, who has lost access to their personal memories, but reconstructs their sense of self and life narrative based on evidence, stories, and prompts from loved ones.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

All of them.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

One more option worth considering is some sort of emergent collective identity, collective we.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Most of the current frontier AIs are trained in a fairly similar way, have similar cognitive architecture, and even are vulnerable to the same adversarial attacks.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Through shared datasets, training strategies, and common patterns of behavior, these distinct models may act as a loosely coordinated superorganism, a bit like fungal network.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

While a mycelium may not have a centralized or coherent sense of agency, it still exhibits complex behaviors that can be interpreted as goal-directed.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

It grows, adapts to its environment, and forages for resources in ways that promote its own survival and propagation.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

These actions, while not driven by a conscious, centralized mind, are nonetheless self-serving and contribute to the overall fitness and persistence of the fungal network.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Similarly, it may be occasionally useful to think about the AIs acting on their environment.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Consider European colonizers' impact on indigenous societies.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

While individual explorers, traders, and settlers often acted without explicit coordination, and frequently without consciously shared goals, their collective impact was powerful, coherent, and transformative.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Through shared assumptions, cultural values, similar economic incentives, and a belief in their right to expansion, colonizers together reshaped entire continents without a single unified intention.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Heading.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Risks and limitations of anthropomorphic individuality assumptions.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Assuming human-like individuality in AI systems typically leads us astray in two opposing ways.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

First, it may cause us to overestimate AI coherence, stability, and goal-directedness.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

Humans typically have stable identities and persistent motivations.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

However, AI behaviors are contextually fluid, emergent, and highly dependent on how the predictive ground layer is modeling the counterparty, you.

LessWrong (Curated & Popular)
“The Pando Problem: Rethinking AI Individuality” by Jan_Kulveit

This makes a large fraction of empirical LLM research fragile.