Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing
Podcast Image

AI Podcast

AI驱动的大规模语言模型训练:Megatron-LM在GPU集群上的高效实践

04 Jan 2025

Description

本期播客深入探讨了如何使用Megatron-LM在GPU集群上高效训练大规模语言模型,重点关注张量并行、流水线并行和数据并行的组合应用,以及创新的交错流水线调度方法。

Audio
Featured in this Episode

No persons identified in this episode.

Transcription

This episode hasn't been transcribed yet

Help us prioritize this episode for transcription by upvoting it.

0 upvotes
🗳️ Sign in to Upvote

Popular episodes get transcribed faster

Comments

There are no comments yet.

Please log in to write the first comment.