Description
欢迎收听AI Radio FM - 科技频道！本期节目，我们将深入探讨大型语言模型推理中令人头疼的非确定性问题。从浮点数非结合性到批量不变性，我们将一步步揭示LLM推理结果不一致的真正原因，并分享如何实现真正可复现、确定性结果的创新方法，包括对RMSNorm、矩阵乘法和注意力机制的批处理不变性改造。此外，我们还将讨论确定性推理对真实在线强化学习的关键意义。跟随我们的专家，weedge，一起攻克这个技术难题！
Audio
Featured in this Episode
No persons identified in this episode.
Transcription
This episode hasn't been transcribed yet
Help us prioritize this episode for transcription by upvoting it.
0
upvotes
Popular episodes get transcribed faster
Other recent transcribed episodes
Transcribed and ready to explore now
Eric Larsen on the emergence and potential of AI in healthcare
10 Dec 2025
McKinsey on Healthcare
Reducing Burnout and Boosting Revenue in ASCs
10 Dec 2025
Becker’s Healthcare -- Spine and Orthopedic Podcast
Dr. Erich G. Anderer, Chief of the Division of Neurosurgery and Surgical Director of Perioperative Services at NYU Langone Hospital–Brooklyn
09 Dec 2025
Becker’s Healthcare -- Spine and Orthopedic Podcast
Dr. Nolan Wessell, Assistant Professor and Well-being Co-Director, Department of Orthopedic Surgery, Division of Spine Surgery, University of Colorado School of Medicine
08 Dec 2025
Becker’s Healthcare -- Spine and Orthopedic Podcast
NPR News: 12-08-2025 2AM EST
08 Dec 2025
NPR News Now
NPR News: 12-08-2025 1AM EST
08 Dec 2025
NPR News Now