Merged
ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10 #14790
景明Add on 12 days ago
ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10 #14790
Merged
Merged fromgitcode_lijd/ops-transformerfix_2intocann/ops-transformermaster
Pull Request has been successfully merged by CANN-robot.
(Thank you for 景明's contribution.)atomgit-bot
12 days ago Comments:
12 days ago Comments:
变更摘要
本 PR 仅调整 CI 编译脚本 scripts/ci/gen_ops_soc.py 中的 group_op_dict 配置,为 ascend950(A5)与 ascend960dt 两档 SoC 增加或调整多算子 obj 编译的拆分组数,以匹配相关算子当前的编译规模;拆分规则本身不变,仍按 op,N-i 生成编译任务并轮询分配到各编译组,不涉及算子 kernel / host 代码。
主要改动
ascend950组数上调:mega_moe由 20 提升至 40、flash_attention_score_grad由 5 提升至 10,增加这两类算子的编译任务拆分组数。ascend950新增算子分组: 新增matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20 三项通信类算子配置。ascend960dt新增分组配置: 新增flash_attention_score=5、mega_moe=40,以及matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20,并使flash_attention_score_grad由 5 提升至 10,与 A5 档配置形成镜像一致。- 其他 SoC 保持原状:
ascend350的flash_attention_score_grad=5 等其余 SoC 配置未作修改。
🧩 本次 Review 已使用自定义 Skill:


Incorrect?
12 days ago Added label: cann-cla/yes
CANN-robot
12 days ago Comments:
12 days ago Comments:
Thanks for your pull-request.
The full list of commands accepted by me can be found at here.
You can get sig-info at here.
You can self-configure the PR merge rules for this repository. For more details, please refer to Here.
For more, you also can visit HICANN.
PR Approval Progress
✅ Congratulations! All modules have met the lgtm and approve requirements.
Module Approval Details
| module | lgtm status | approve status |
|---|---|---|
| scripts | ✅ xtqh, 蒋礼锐 (2/2) | ✅ 蒋礼锐 (1/1) |
💡 Tip:
- Committer can comment
/approveor/lgtm- Commenting
/approveimplies both code review (lgtm) and intent to merge (approve)
CLA Signature Pass
gitcode_lijd, thanks for your pull request. All authors of the commits have signed the CLA. 👍


12 days ago Set monologue815,jiang-lirui,Allan_Yu,wang-minbo,xtqh,liudan12,gaoxiang618,mabing1118 as approver
12 days ago Set monologue815,jiang-lirui,Allan_Yu,wang-minbo,xtqh,liudan12,gaoxiang618,mabing1118 as approver
12 days ago Set monologue815,jiang-lirui,Allan_Yu,wang-minbo,xtqh,liudan12,gaoxiang618,mabing1118 as approver
12 days ago Set monologue815,jiang-lirui,Allan_Yu,wang-minbo,xtqh,liudan12,gaoxiang618,mabing1118 as approver
11 days ago Change title to "ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10", originally titled "ci(gen_ops_soc): A5/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10".
11 days ago Change title to "ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10", originally titled "ci(gen_ops_soc): A5/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10".
景明
10 days ago Comments:
10 days ago Comments:
compile


10 days ago Pre merge succeeded (commit_id: 9487494a555e8d128a755c7a12f78dbc666c055e)
CANN-robot
10 days ago Comments:
10 days ago Comments:
| 🚀 CI 流水线已启动 |
|---|
| 📋 执行详情: 点击查看流水线 |


10 days ago Added label: ci-pipeline-running
10 days ago Removed label: ci-pipeline-running
10 days ago Added label: ci-pipeline-passed
jiang-lirui
10 days ago Comments:
10 days ago Comments:
/approve
/lgtm


10 days ago Added label: lgtmapproved
10 days ago Merged pull request
描述
CI 编译适配:为
ascend950(A5)与ascend960dt两档新增/调整多算子 obj 编译拆分组数,适配相关算子当前编译规模。改动内容
仅涉及
scripts/ci/gen_ops_soc.py的group_op_dict(1 文件,11 增 3 删):ascend950(A5):mega_moe20→40、flash_attention_score_grad5→10matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20ascend960dt(与 A5 镜像同步):flash_attention_score=5、mega_moe=40、matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20flash_attention_score_grad5→10op,N-i生成编译任务并轮询分配至各编译组,仅组数变化ascend910b/ascend910_93/ascend350)配置不变影响面
仅影响 CI 编译任务拆分,不涉及任何算子 kernel / host 代码。已确认全部算子
_def.cpp注册支持ascend960dt(其中allto_all_matmul的 960dt 注册受 CANN>=9.3 版本宏守卫)。验证
python3 scripts/ci/gen_ops_soc.py:正常生成、退出码 0group_op_dict:A5 / 960dt 两档字典值一致(7 算子全量镜像),符合预期