Merged
ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10 #14790
ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10 #14790
Merged
景明Add on 12 days ago
景明
景明Collaborators
12 days ago

描述

CI 编译适配:为 ascend950(A5)与 ascend960dt 两档新增/调整多算子 obj 编译拆分组数,适配相关算子当前编译规模。

改动内容

仅涉及 scripts/ci/gen_ops_soc.py 的 group_op_dict(1 文件,11 增 3 删):

  • ascend950(A5):
    • 调整:mega_moe 20→40、flash_attention_score_grad 5→10
    • 新增:matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20
  • ascend960dt(与 A5 镜像同步):
    • 新增:flash_attention_score=5、mega_moe=40、matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20
    • 调整:flash_attention_score_grad 5→10
  • 拆分规则不变:仍按 op,N-i 生成编译任务并轮询分配至各编译组,仅组数变化
  • 其他 SoC(ascend910b / ascend910_93 / ascend350)配置不变

影响面

仅影响 CI 编译任务拆分,不涉及任何算子 kernel / host 代码。已确认全部算子 _def.cpp 注册支持 ascend960dt(其中 allto_all_matmul 的 960dt 注册受 CANN>=9.3 版本宏守卫)。

验证

  • 本地实跑 python3 scripts/ci/gen_ops_soc.py:正常生成、退出码 0
  • 直接校验 group_op_dict:A5 / 960dt 两档字典值一致(7 算子全量镜像),符合预期
  • pre-commit 全钩子 Passed(ruff / codespell / OAT 等),无格式化改动
likedislike
Pull Request has been successfully merged by CANN-robot.
(Thank you for 景明's contribution.)
景明景明Collaborators
12 days ago Created pull request, commit 20282b5a
atomgit-bot
atomgit-bot
12 days ago Comments:

变更摘要

本 PR 仅调整 CI 编译脚本 scripts/ci/gen_ops_soc.py 中的 group_op_dict 配置,为 ascend950(A5)与 ascend960dt 两档 SoC 增加或调整多算子 obj 编译的拆分组数,以匹配相关算子当前的编译规模;拆分规则本身不变,仍按 op,N-i 生成编译任务并轮询分配到各编译组,不涉及算子 kernel / host 代码。

主要改动

  • ascend950 组数上调: mega_moe 由 20 提升至 40、flash_attention_score_grad 由 5 提升至 10,增加这两类算子的编译任务拆分组数。
  • ascend950 新增算子分组: 新增 matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20 三项通信类算子配置。
  • ascend960dt 新增分组配置: 新增 flash_attention_score=5、mega_moe=40,以及 matmul_all_reduce=40、allto_all_matmul=20、matmul_reduce_scatter_v2=20,并使 flash_attention_score_grad 由 5 提升至 10,与 A5 档配置形成镜像一致。
  • 其他 SoC 保持原状: ascend350 的 flash_attention_score_grad=5 等其余 SoC 配置未作修改。

🧩 本次 Review 已使用自定义 Skill:

likedislike
Incorrect?
CANN-robotCANN-robotCollaborators
12 days ago Added label: cann-cla/yes
CANN-robot
CANN-robotCollaborators
12 days ago Comments:

Thanks for your pull-request.
The full list of commands accepted by me can be found at here.
You can get sig-info at here.
You can self-configure the PR merge rules for this repository. For more details, please refer to Here.
For more, you also can visit HICANN.


PR Approval Progress

✅ Congratulations! All modules have met the lgtm and approve requirements.

Module Approval Details

module lgtm status approve status
scripts ✅ xtqh, 蒋礼锐 (2/2) ✅ 蒋礼锐 (1/1)

💡 Tip:

  • Committer can comment /approve or /lgtm
  • Commenting /approve implies both code review (lgtm) and intent to merge (approve)

CLA Signature Pass

gitcode_lijd, thanks for your pull request. All authors of the commits have signed the CLA. 👍

likedislike
CANN-robotCANN-robotCollaborators
12 days ago Set monologue815,jiang-lirui,Allan_Yu,wang-minbo,xtqh,liudan12,gaoxiang618,mabing1118 as approver
CANN-robotCANN-robotCollaborators
12 days ago Set monologue815,jiang-lirui,Allan_Yu,wang-minbo,xtqh,liudan12,gaoxiang618,mabing1118 as approver
景明景明Collaborators
11 days ago Change title to "ci(gen_ops_soc): 950/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10", originally titled "ci(gen_ops_soc): A5/960dt 编译obj分组配置——新增matmul_all_reduce等5项,mega_moe 20→40、grad 5→10".
景明
景明Collaborators
10 days ago Comments:

compile

likedislike
景明景明Collaborators
10 days ago Pre merge succeeded (commit_id: 9487494a555e8d128a755c7a12f78dbc666c055e)
CANN-robot
CANN-robotCollaborators
10 days ago Comments:
🚀 CI 流水线已启动
📋 执行详情: 点击查看流水线
likedislike
CANN-robotCANN-robotCollaborators
10 days ago Added label: ci-pipeline-running
CANN-robotCANN-robotCollaborators
10 days ago Removed label: ci-pipeline-running
CANN-robotCANN-robotCollaborators
10 days ago Added label: ci-pipeline-passed
xtqhCollaborators
10 days ago Comments:

/lgtm

likedislike
jiang-liruiCollaborators
10 days ago Comments:

/approve
/lgtm

likedislike
CANN-robotCANN-robotCollaborators
10 days ago Added label: lgtmapproved
CANN-robotCANN-robotCollaborators
10 days ago Merged pull request