| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
disttrain intervl2 适配开箱 Co-authored-by: gcw_amOUPDs9<fuyuefeng@huawei.com> # message auto-generated for no-merge-commit merge: !2915 merge master into master disttrain intervl2 适配开箱 Created-by: gcw_amOUPDs9 Commit-by: gcw_amOUPDs9 Merged-by: ascend-robot Description: disttrain intervl2 适配开箱 disttrain intervl2 适配开箱 See merge request: Ascend/MindSpeed!2915 | 10 个月前 | |
Add triton fusion operator sort_chunks_by_idx and testcase Signed-off-by: guofanfeng<guofanfeng1@huawei.com> | 9 个月前 | |
Add triton fusion operator sort_chunks_by_idx and testcase Signed-off-by: guofanfeng<guofanfeng1@huawei.com> | 9 个月前 | |
| 1 年前 | ||
Add triton fusion operator sort_chunks_by_idx and testcase Signed-off-by: guofanfeng<guofanfeng1@huawei.com> | 9 个月前 | |
!3001 merge master into master [mindspore][patch][master]del patch Created-by: ybwang19 Commit-by: ybwang19 Merged-by: gp513 Description: del patch 关联PR:[https://gitcode.com/Ascend/MindSpeed-LLM/pull/3696](https://gitcode.com/Ascend/MindSpeed-LLM/pull/3696) See merge request: Ascend/MindSpeed!3001 | 9 个月前 | |
remove deprecated code 2 Co-authored-by: 赵一帆<zhaoyifan15@huawei.com> # message auto-generated for no-merge-commit merge: !2972 merge master into master remove deprecated code 2 Created-by: zhao-yifan27 Commit-by: 赵一帆 Merged-by: ascend-robot Description: 删除废弃代码 mindspeed/model下废弃代码 mindspeed/moe下ampipe废弃代码 See merge request: Ascend/MindSpeed!2972 | 10 个月前 | |
remove deprecated code 2 Co-authored-by: 赵一帆<zhaoyifan15@huawei.com> # message auto-generated for no-merge-commit merge: !2972 merge master into master remove deprecated code 2 Created-by: zhao-yifan27 Commit-by: 赵一帆 Merged-by: ascend-robot Description: 删除废弃代码 mindspeed/model下废弃代码 mindspeed/moe下ampipe废弃代码 See merge request: Ascend/MindSpeed!2972 | 10 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
quant fp8 optimizer | 10 个月前 | |
| 2 年前 | ||
fixbug for te Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3062 merge fixbug_for_te into master fixbug for te Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: fixbug: get_args().fp8 is none See merge request: Ascend/MindSpeed!3062 | 9 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
Support TransformerEngine Co-authored-by: MingzhenWang<wangmingzhen4@huawei.com> Co-authored-by: Muu<koimuu@163.com> Co-authored-by: x30061065<xuyuanhui3@h-partners.com> Co-authored-by: 耿瑞良<gengruiliang@huawei.com> # message auto-generated for no-merge-commit merge: !2947 merge lingqu_master into master Support TransformerEngine Created-by: mingzhenwang Commit-by: mingzhenwang;Muu;MingzhenWang;x30061065;耿瑞良 Merged-by: ascend-robot Description: 1. 支持TELinear层 2. 支持FP8计算,quantmatmul/gmm 3. 支持多种数据类型FP8/HiF8 4. 支持多种量化策略delayed/tensorwise/blockwise/mxfp8 5. TELinear层支持通算融合 See merge request: Ascend/MindSpeed!2947 | 9 个月前 | |
[Bugfix]Fix distributed weight loading in Megatron and add recomputation support for FSDP2 Co-authored-by: zs-Derrick<1434012475@qq.com> # message auto-generated for no-merge-commit merge: merge master into master [Bugfix]Fix distributed weight loading in Megatron and add recomputation support for FSDP2 Created-by: zs-derrick1 Commit-by: zs-Derrick Merged-by: ascend-robot Description: [Bugfix]Fix distributed weight loading in Megatron and add recomputation support for FSDP2 1、修改megatron原生load_checkpoint函数中torch_dcp分支的逻辑bug,添加条件判断 2、FSDP2添加重计算入口 See merge request: Ascend/MindSpeed!2834 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
【bugfix!!!】fbov COC&share_expert_sync fix Co-authored-by: EX_mitsu<yangjie409@h-partners.com> # message auto-generated for no-merge-commit merge: !3005 merge master into master 【bugfix!!!】fbov COC&share_expert_sync fix Created-by: EX_mitsuX Commit-by: EX_mitsuX;EX_mitsu Merged-by: ascend-robot Description: 修复TP1状态下开启COC未进行检查的BUG(非预期场景。TP1开COC应当无收益。)。 重新调整计算流,追加等待及同步,修复计算速度过快时可能产生的同步问题(问题场景:同时开启COC,permute融合算子及共享专家出现,使用launch_blocking该问题消失)。 修复不再兼容的TE检测。 修复TE部分module的属性缺失。 See merge request: Ascend/MindSpeed!3005 | 9 个月前 | |
| 1 年前 | ||
增加MOE专家负载均衡功能 Co-authored-by: zhanggaolu2<252028123@qq.com> # message auto-generated for no-merge-commit merge: !2845 merge expert_loadbalance2master into master 增加MOE专家负载均衡功能 Created-by: zhanggaolu2 Commit-by: zhanggaolu2 Merged-by: ascend-robot Description: 增加MOE专家负载均衡功能 See merge request: Ascend/MindSpeed!2845 | 10 个月前 | |
| 1 年前 | ||
| 1 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 10 个月前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 2 年前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 |