“Several frontier models are substantially prefill aware” by yeedrag, Parv Mahajan, David Africa, alexsouly, Jordan Taylor, RobertKirk

episode

LessWrong (30+ Karma) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from LessWrong (30+ Karma)

“Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins” by Michaël Trazzi 3 min · 20 Dec 2025

All episodes from LessWrong (30+ Karma) →

Report any issue

Source

Recorded17 Jun 2026

Publisherfeeds.type3.audio ↗

Handlerec:18916894

Show notes

This blog post discusses work in a recently-published paper. However, this blogpost was primarily written by Parv Mahajan and Andy Wang, and several of the more speculative takes may not represent the all-things-considered view of the entire team. Link to paper: https://arxiv.org/abs/2606.12747 TL;DR: We provide more conceptual grounding and extend results in prefill awareness to low-stakes settings, and show that several frontier models show prefill awareness even under conservative elicitation.Further behavioral studies are pretty messy, and we encourage more work in this area.We encourage frontier lab safety teams to measure and mitigate prefill awareness in pre-deployment evaluations. Recently, UK AISI investigated prefill awareness - whether frontier language models can distinguish between tampered and untampered assistant-side content. Prefills are used in misalignment continuation, persona, introspection, and jailbreaking research. Additionally, several prefill-based evaluations are used in pre-deployment testing to make safety claims. Prefill awareness could confound these evaluations, and fits into larger concerns about situational awareness (e.g., control awareness). The previous results largely focused on deployment-relevant settings (e.g., SWE-bench and Petri transcripts), and therefore weren’t able to make strong claims across types of commonly-used prefills and models. In the paper, we: Use a more refined conceptual framework [...] ---Outline:(02:38) Making sense of prefill awareness(04:32) en-US-AvaMultilingualNeural__ Diagram comparing three types of AI assistant response tampering methods.(05:31) Several models are prefill-aware(07:49) Prefill awareness is heterogeneous and confusing(09:33) Recommendations and next steps --- First published: June 17th, 2026 Source: https://www.lesswrong.com/posts/iMds4tTpMH4pSHEej/several-frontier-models-are-substantially-prefill-aware --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.