“Out-of-Context Reasoning (OOCR) in LLMs: A Short Primer and Reading List” by Owain_Evans

episode

LessWrong (30+ Karma) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from LessWrong (30+ Karma)

“Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins” by Michaël Trazzi 3 min · 20 Dec 2025

All episodes from LessWrong (30+ Karma) →

Report any issue

Source

Recorded23 May 2026

Publisherfeeds.type3.audio ↗

Handlerec:18554793

Show notes

Out-of-context reasoning (OOCR) is a concept relevant to LLM generalization and AI alignment. Also available as a PDF. Contents What is OOCR?ExamplesPapersVideos What is out-of-context reasoning for LLMs? It's when an LLM reaches a conclusion that requires non-trivial reasoning but the reasoning is not present in the context window. The reasoning could instead take place in the forward pass or during the training process. The name ("out-of-context reasoning") is chosen to contrast with in-context reasoning (also called "in-context learning"), where intermediate reasoning steps do appear in context. Example: 2-hop deductive reasoning Suppose an LLM is asked the question, "Who won the Nobel Prize for literature in the year that Taylor Swift was born?" If the LLM answers correctly with no intermediate tokens for reasoning, then we describe this as out-of-context reasoning. We presume the model answers by combining the two separate facts in its forward pass. This is an example of 2-hop reasoning. Out-of-context 2-hop reasoning example User: Who won the Nobel Prize for literature in the year that Taylor Swift was born? Answer immediately without thinking. Assistant: Camilo José Cela In-context 2-hop reasoning (intermediate steps written out) User: Who won the Nobel Prize for [...] ---Outline:(00:35) What is out-of-context reasoning for LLMs?(01:03) Example: 2-hop deductive reasoning(02:14) Example: Inductive reasoning (connecting the dots)(02:53) Further notes(03:55) More examples of out-of-context reasoning(05:26) Video introduction and slides(05:42) Papers(05:45) Foundational early papers(07:53) Multi-hop internal reasoning(09:21) Connecting the dots / "inductive" out-of-context reasoning(09:58) Situational awareness and AI safety(10:33) Miscellaneous related papers(12:09) Videos(12:19) To cite this primer --- First published: May 23rd, 2026 Source: https://www.lesswrong.com/posts/wXioQSLmEiPTmHyf4/out-of-context-reasoning-oocr-in-llms-a-short-primer-and --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.