0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robotfeat: Add MXFP8 support for FSDP
4ddce1d2创建于 4月16日历史提交
文件最后提交记录最后更新时间
distributed
feat:fused permute Co-authored-by: ryanyeee<yezhenyuan@huawei.com> # message auto-generated for no-merge-commit merge: !3324 merge master into master feat:fused permute Created-by: ryanyeee Commit-by: ryanyeee Merged-by: ascend-robot Description: https://wiki.huawei.com/domains/95206/wiki/352161/WIKI2026031710444457 See merge request: Ascend/MindSpeed!33242 个月前
memory
feat: add mix precision and prefetch for fsdp2 Co-authored-by: sunjunjie1587<sunjunjie8@huawei.com> # message auto-generated for no-merge-commit merge: !3215 merge master into master feat: add mix precision and prefetch for fsdp2 Created-by: sunjunjie1587 Commit-by: sunjunjie1587 Merged-by: ascend-robot Description: add mix precision and prefetch for fsdp2 See merge request: Ascend/MindSpeed!32154 个月前
quantization
feat: Add MXFP8 support for FSDP Co-authored-by: EVA1<jingsiyu1@huawei.com> Co-authored-by: quancs001<quancs@qq.com> Co-authored-by: h00638954<huangzhiyuan8@huawei.com> # message auto-generated for no-merge-commit merge: !3387 merge fsdp_lp_ag into master feat: Add MXFP8 support for FSDP Created-by: quancs001 Commit-by: EVA1;quancs001;h00638954 Merged-by: ascend-robot Description: 在FSDP框架下新增MXFP8 Dense/MoE模型训练支持，实现了包括： 1. 基础的低精通信+FSDP框架 2. 实现了对MXFP8+低精通信的支持 3. MoE模型，支持了EP、EFSDP的适配 See merge request: Ascend/MindSpeed!33871 个月前
utils
fix: Decoupling FSDP basic capabilities from NPU Co-authored-by: zhyebin01<zhangyebin@h-partners.com> # message auto-generated for no-merge-commit merge: !3336 merge master into master fix: Decoupling FSDP basic capabilities from NPU Created-by: zhyebin01 Commit-by: zhyebin01 Merged-by: ascend-robot Description: ### What this PR does / why we need it? Decoupling FSDP basic capabilities from NPU ### Does this PR introduce any user-facing change? No ### How was this patch tested? pipeline test passed See merge request: Ascend/MindSpeed!33362 个月前
__init__.py
feat:mindspeed fsdp Co-authored-by: ryanyeee<yezhenyuan@huawei.com> # message auto-generated for no-merge-commit merge: !3198 merge master into master feat:mindspeed fsdp Created-by: ryanyeee Commit-by: ryanyeee Merged-by: ascend-robot Description: feat:mindspeed fsdp See merge request: Ascend/MindSpeed!31984 个月前
mindspeed_parallel_engine.py
feat: Add MXFP8 support for FSDP Co-authored-by: EVA1<jingsiyu1@huawei.com> Co-authored-by: quancs001<quancs@qq.com> Co-authored-by: h00638954<huangzhiyuan8@huawei.com> # message auto-generated for no-merge-commit merge: !3387 merge fsdp_lp_ag into master feat: Add MXFP8 support for FSDP Created-by: quancs001 Commit-by: EVA1;quancs001;h00638954 Merged-by: ascend-robot Description: 在FSDP框架下新增MXFP8 Dense/MoE模型训练支持，实现了包括： 1. 基础的低精通信+FSDP框架 2. 实现了对MXFP8+低精通信的支持 3. MoE模型，支持了EP、EFSDP的适配 See merge request: Ascend/MindSpeed!33871 个月前
parallel_engine_config.py
feat: Add MXFP8 support for FSDP Co-authored-by: EVA1<jingsiyu1@huawei.com> Co-authored-by: quancs001<quancs@qq.com> Co-authored-by: h00638954<huangzhiyuan8@huawei.com> # message auto-generated for no-merge-commit merge: !3387 merge fsdp_lp_ag into master feat: Add MXFP8 support for FSDP Created-by: quancs001 Commit-by: EVA1;quancs001;h00638954 Merged-by: ascend-robot Description: 在FSDP框架下新增MXFP8 Dense/MoE模型训练支持，实现了包括： 1. 基础的低精通信+FSDP框架 2. 实现了对MXFP8+低精通信的支持 3. MoE模型，支持了EP、EFSDP的适配 See merge request: Ascend/MindSpeed!33871 个月前