“Features that current AIs don’t have that future AIs will have” by Alexander Gietelink Oldenziel

episode

LessWrong (30+ Karma) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from LessWrong (30+ Karma)

“Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins” by Michaël Trazzi 3 min · 20 Dec 2025

All episodes from LessWrong (30+ Karma) →

Report any issue

Source

Recorded14 Aug 2026

Publisherfeeds.type3.audio ↗

Handlerec:20006718

Show notes

Features that current AIs don't have that future AIs will have: Continual Learning [& long-term memory] Every second humans update their brain weights. The brain autonomously decides what to update on. Humans can also consciously decide to curate their data sets - eg by deciding to go to college. Current LLMs do not continually update their weights. Instead, they occasionally get a large update based on datasets curated by a team of humans. This is alleviated somewhat by the ability of AIs to do in-context learning but nevertheless it seems to be a major limitation. Note that this is an especially large limitation in domains with sparse data. In domains where all of humanity has an enormous amount of data eg math, programming, physics, anime trivia, trials and tribulations of English kings - AIs dominate. In areas where there is little data: the weird idiosyncracies of a particular job, boss, people, colleagues etc it can struggle. Note that this restrictions also interferes with AIs from effectively 'learning to learn' & caps its long-term memory. Neuralese Current AI's CoT is (mostly) English. But it plausible this is not the most efficient way to structure thoughts. Instead of english [...] ---Outline:(00:16) Continual Learning \[& long-term memory\](01:24) Neuralese(01:41) Telepathy(02:01) ClaudeGlobal --- First published: August 13th, 2026 Source: https://www.lesswrong.com/posts/NyEM3FtgL7XkbfCXy/features-that-current-ais-don-t-have-that-future-ais-will --- Narrated by TYPE III AUDIO.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.