2025年6月7日
[PaperReading] PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
摘要： 目录PyTorch FSDP: Experiences on Scaling Fully Sharded Data ParallelTL;DRMethodSystem DesignModel InitializationSharding Strategies（分片策略）​​Full Sharding 阅读全文
posted @ 2025-06-07 18:44 fariver 阅读(128) 评论(0) 推荐(0)