#77- Ring Attention e janelas de contexto de 1M, o RAG está morto?

episode

Vida com IA not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

AWP: Beyond the Exam Room: Purpose, Myopia, and Population Health 54 min · 17 Sep 2026 · EyeCode Media

Essentials: How to Assess & Improve All Aspects of Your Fitness | Dr. Andy Galpin 35 min · 17 Sep 2026 · Huberman Lab

#502 – Psychiatry, Insane Asylums, Mental Illness, ECT, Lobotomies, Freud & Jung 3h 43m · 17 Sep 2026 · Lex Fridman Podcast

September 16, 2026 PC - Sep 16, 2026 1h 50m · 16 Sep 2026 · Fairfax County Planning Commission

Planning Commision 09/16/2026 - Sep 16, 2026 56 min · 16 Sep 2026 · Prince William County Planning Commission

Western Loudoun Rural Uses and Standards PCZOC Ad Hoc Meeting 2 - Sep 16, 2026 4h 45m · 16 Sep 2026 · Loudoun County Board Committees and Advisory Boards

Report any issue

Source

Recorded07 Mar 2024

Publisheranchor.fm ↗

Handlerec:12635335

Show notes

Fala galera, nesse episódio eu explico como a gente consegue escalar a janela de contexto de um LLM pra mais de 1 milhão de tokens usando Ring Attention. Além disso eu discuto se a abordagem usando RAG está morta com esses avanços na janela de contexto. Paper Lost in the Middle: https://arxiv.org/pdf/2307.03172.pdf Gemini technical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf Paper Ring Attention: https://arxiv.org/pdf/2310.01889.pdf Instagram do podcast: https://www.instagram.com/podcast.lifewithai Linkedin do podcast: https://www.linkedin.com/company/life-with-ai

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in