| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
doc: adjust doc Co-authored-by: liutongtong27<liutongtong15@h-partners.com> # message auto-generated for no-merge-commit merge: !3305 merge master_menutest into master doc: adjust doc Created-by: liutongtong27 Commit-by: liutongtong27 Merged-by: ascend-robot Description: What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3305 | 5 个月前 | |
fix: use MindSpeed full args in MoE utils Co-authored-by: Zhangminjie<eddy_zmj@qq.com> # message auto-generated for no-merge-commit merge: !3575 merge zmj/fix-moe-get-args-initialization into master fix: use MindSpeed full args in MoE utils Created-by: MengyuyangEddy Commit-by: Zhangminjie Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR fixes an argument initialization issue in the MindSpeed MoE router path. When running the MoE router with the MindSpeed runtime, topk_softmax_with_capacity() calls get_args() through mindspeed/core/transformer/moe/moe_utils.py. The previous implementation imported get_args from Megatron: python from megatron.training import get_args However, in the MindSpeed/veRL runtime path, Megatron global args may not be initialized through the native Megatron training entrypoint. As a result, calling Megatron's get_args() can trigger the following error: text AssertionError: args is not initialized This PR replaces the import with MindSpeed's full-args helper: python from mindspeed.args_utils import get_full_args as get_args This keeps the existing get_args() call sites unchanged while avoiding the dependency on Megatron's uninitialized global _GLOBAL_ARGS. The change is limited to the argument source used by MoE utils. It does not change the MoE router algorithm, top-k routing logic, capacity calculation, token dispatching behavior, or expert computation. ## Does this PR introduce any user-facing change? No. This PR does not introduce any user-facing API or configuration change. Existing scripts and configs can continue to call the same MoE/MindSpeed paths without modification. The only behavior change is that MoE utils now obtain runtime arguments from MindSpeed's get_full_args() instead of Megatron's global get_args(), which fixes the args is not initialized failure in MindSpeed runtime scenarios. ## How was this patch tested?  pre-commit:  See merge request: Ascend/MindSpeed!3575 | 2 个月前 | |
fix: TE LayerNormLinear init weight order align NVTE Co-authored-by: clc2025<chenlucong@huawei.com> # message auto-generated for no-merge-commit merge: !3569 merge fix_lnliner_initweight into master fix: TE LayerNormLinear init weight order align NVTE Created-by: clc2025 Commit-by: clc2025 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 具体查看关联issue ## Does this PR introduce any user-facing change? NA ## How was this patch tested? 基于脚本用例，从GPU上保存权重，NPU加载权重后断点续训，精度能对齐且无功能报错 See merge request: Ascend/MindSpeed!3569 | 2 个月前 | |
[Features] mxfp8: fix hard code Co-authored-by: yangx_sy<sunyang49@huawei.com> # message auto-generated for no-merge-commit merge: !3493 merge fsdp2_fp8 into master [Features] mxfp8: fix hard code Created-by: yangx_sy Commit-by: yangx_sy Merged-by: ascend-robot Description: What this PR does / why we need it? mxfp8: fix hard code Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3493 | 2 个月前 | |
fix: NPU datadump level: L0 & mix Co-authored-by: yulelanmei<huangyijie8@huawei.com> # message auto-generated for no-merge-commit merge: !3351 merge master into master fix: NPU datadump level: L0 & mix Created-by: yulelanmei Commit-by: yulelanmei Merged-by: ascend-robot Description: What this PR does / why we need it? 当前--npu-datadump未适配 L0及mix 的dump等级，需要增强功能 Does this PR introduce any user-facing change? N/A How was this patch tested? 开启--npu-datadump，config.json配置level为L0或mix 测试：https://wiki.huawei.com/domains/148330/wiki/296621/WIKI2026032510543405 See merge request: Ascend/MindSpeed!3351 | 5 个月前 | |
style:Triton operator path normalization. Co-authored-by: LinShua<707894133@qq.com> # message auto-generated for no-merge-commit merge: !3432 merge master_GDN_triton_stype into master style:Triton operator path normalization. Created-by: LinShua Commit-by: LinShua Merged-by: ascend-robot Description: What this PR does / why we need it? 删除lite路径下的GDN算子，后续统一归档到ops路径下； 对应关联issue：https://gitcode.com/Ascend/MindSpeed/issues/147 Does this PR introduce any user-facing change? NA How was this patch tested? 见PR中的test文件 See merge request: Ascend/MindSpeed!3432 | 4 个月前 | |
[modify][mindspore] register patchs for coalescing_manager Co-authored-by: weixin_47897441<wuyouqi1@h-partners.com> # message auto-generated for no-merge-commit merge: !3233 merge master-0129 into master [modify][mindspore] register patchs for coalescing_manager Created-by: weixin_47897441 Commit-by: weixin_47897441 Merged-by: ascend-robot Description: [modify][mindspore] register patchs for coalescing_manager： The coalescing_manager-related patches have recently been removed from megtron_basic.py. Given that MSA currently lacks support for communication operators associated with coalescing_manager, these removed patches are migrated to MindSpore to ensure normal launch of models such as qwen3vl. See merge request: Ascend/MindSpeed!3233 | 7 个月前 | |
remove deprecated code 2 Co-authored-by: 赵一帆<zhaoyifan15@huawei.com> # message auto-generated for no-merge-commit merge: !2972 merge master into master remove deprecated code 2 Created-by: zhao-yifan27 Commit-by: 赵一帆 Merged-by: ascend-robot Description: 删除废弃代码 mindspeed/model下废弃代码 mindspeed/moe下ampipe废弃代码 See merge request: Ascend/MindSpeed!2972 | 9 个月前 | |
remove deprecated code 2 Co-authored-by: 赵一帆<zhaoyifan15@huawei.com> # message auto-generated for no-merge-commit merge: !2972 merge master into master remove deprecated code 2 Created-by: zhao-yifan27 Commit-by: 赵一帆 Merged-by: ascend-robot Description: 删除废弃代码 mindspeed/model下废弃代码 mindspeed/moe下ampipe废弃代码 See merge request: Ascend/MindSpeed!2972 | 9 个月前 | |
| 1 年前 | ||
Feat: adaptor for DeepSeek V4 Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3427 merge master into master Feat: adaptor for DeepSeek V4 Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: What this PR does / why we need it? Adaptor for DeepSeek V4!!! Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3427 | 4 个月前 | |
refactor(ops): generalize NPU version detection with NPUVersion enum Co-authored-by: Muu<koimuu@163.com> # message auto-generated for no-merge-commit merge: !3544 merge dev into master refactor(ops): generalize NPU version detection with NPUVersion enum Created-by: Muuyo Commit-by: Muu Merged-by: ascend-robot Description: refactor(ops): generalize NPU version detection with NPUVersion enum See merge request: Ascend/MindSpeed!3544 | 3 个月前 | |
fix: TE LayerNormLinear init weight order align NVTE Co-authored-by: clc2025<chenlucong@huawei.com> # message auto-generated for no-merge-commit merge: !3569 merge fix_lnliner_initweight into master fix: TE LayerNormLinear init weight order align NVTE Created-by: clc2025 Commit-by: clc2025 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 具体查看关联issue ## Does this PR introduce any user-facing change? NA ## How was this patch tested? 基于脚本用例，从GPU上保存权重，NPU加载权重后断点续训，精度能对齐且无功能报错 See merge request: Ascend/MindSpeed!3569 | 2 个月前 | |
| 1 年前 | ||
fix: TE LayerNormLinear init weight order align NVTE Co-authored-by: clc2025<chenlucong@huawei.com> # message auto-generated for no-merge-commit merge: !3569 merge fix_lnliner_initweight into master fix: TE LayerNormLinear init weight order align NVTE Created-by: clc2025 Commit-by: clc2025 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 具体查看关联issue ## Does this PR introduce any user-facing change? NA ## How was this patch tested? 基于脚本用例，从GPU上保存权重，NPU加载权重后断点续训，精度能对齐且无功能报错 See merge request: Ascend/MindSpeed!3569 | 2 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
Support TransformerEngine Co-authored-by: MingzhenWang<wangmingzhen4@huawei.com> Co-authored-by: Muu<koimuu@163.com> Co-authored-by: x30061065<xuyuanhui3@h-partners.com> Co-authored-by: 耿瑞良<gengruiliang@huawei.com> # message auto-generated for no-merge-commit merge: !2947 merge lingqu_master into master Support TransformerEngine Created-by: mingzhenwang Commit-by: mingzhenwang;Muu;MingzhenWang;x30061065;耿瑞良 Merged-by: ascend-robot Description: 1. 支持TELinear层 2. 支持FP8计算，quantmatmul/gmm 3. 支持多种数据类型FP8/HiF8 4. 支持多种量化策略delayed/tensorwise/blockwise/mxfp8 5. TELinear层支持通算融合 See merge request: Ascend/MindSpeed!2947 | 9 个月前 | |
[Bugfix] Fix Megatron checkpoint saving&loading compatibility for torch_dcp format Co-authored-by: 林明哲<linmingzhe3@huawei.com> # message auto-generated for no-merge-commit merge: !3077 merge fix1202 into master [Bugfix] Fix Megatron checkpoint saving&loading compatibility for torch_dcp format Created-by: LinMingZhe Commit-by: 林明哲 Merged-by: ascend-robot Description: Fix Megatron checkpoint saving&loading compatibility for torch_dcp format See merge request: Ascend/MindSpeed!3077 | 8 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
【bugfix!!!】fbov COC&share_expert_sync fix Co-authored-by: EX_mitsu<yangjie409@h-partners.com> # message auto-generated for no-merge-commit merge: !3005 merge master into master 【bugfix!!!】fbov COC&share_expert_sync fix Created-by: EX_mitsuX Commit-by: EX_mitsuX;EX_mitsu Merged-by: ascend-robot Description: 修复TP1状态下开启COC未进行检查的BUG（非预期场景。TP1开COC应当无收益。）。 重新调整计算流，追加等待及同步，修复计算速度过快时可能产生的同步问题（问题场景：同时开启COC，permute融合算子及共享专家出现，使用launch_blocking该问题消失）。 修复不再兼容的TE检测。 修复TE部分module的属性缺失。 See merge request: Ascend/MindSpeed!3005 | 9 个月前 | |
fix：Add mindspeed config to subclass of transformer config Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3284 merge master into master fix：Add mindspeed config to subclass of transformer config Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: Add mindspeed config to subclass of transformer config See merge request: Ascend/MindSpeed!3284 | 6 个月前 | |
增加MOE专家负载均衡功能 Co-authored-by: zhanggaolu2<252028123@qq.com> # message auto-generated for no-merge-commit merge: !2845 merge expert_loadbalance2master into master 增加MOE专家负载均衡功能 Created-by: zhanggaolu2 Commit-by: zhanggaolu2 Merged-by: ascend-robot Description: 增加MOE专家负载均衡功能 See merge request: Ascend/MindSpeed!2845 | 10 个月前 | |
fix: fix the alltoall_seq token dispatcher Nan bug Co-authored-by: guofanfeng<guofanfeng1@huawei.com> # message auto-generated for no-merge-commit merge: !3249 merge bug_fix into master fix: fix the alltoall_seq token dispatcher Nan bug Created-by: guofanfeng23 Commit-by: guofanfeng Merged-by: ascend-robot Description: fix the alltoall_seq token dispatcher Nan bug https://wiki.huawei.com/domains/152732/wiki/307991/WIKI2026020210028614 See merge request: Ascend/MindSpeed!3249 | 6 个月前 | |
| 1 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 5 个月前 | ||
| 2 个月前 | ||
| 2 个月前 | ||
| 2 个月前 | ||
| 5 个月前 | ||
| 4 个月前 | ||
| 7 个月前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 4 个月前 | ||
| 3 个月前 | ||
| 2 个月前 | ||
| 1 年前 | ||
| 2 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 9 个月前 | ||
| 8 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 6 个月前 | ||
| 10 个月前 | ||
| 6 个月前 | ||
| 1 年前 |