master

ascend-robotfeat: add get_p2p_stream_id interface for HCCL backend

c353d497创建于 3月25日历史提交

文件	最后提交记录	最后更新时间
_fault_mode_cases	!17268 Fixed the test_fault_mode.py Merge pull request !17268 from yuhaiyan/master-dev1	1 年前
_spmd	!12069 [feature]Support Functional Collectives Merge pull request !12069 from 叶子凡/master_functional_collectives	2 年前
_tensor	fix cast stridedshard error Co-authored-by: kisnwang<wangkaisheng2@huawei.com> # message auto-generated for no-merge-commit merge: !31360 merge master into master fix cast stridedshard error Created-by: kisnwang Commit-by: kisnwang Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 > <font color="red">**如有社区issue，请关联issue链接**</font>\ > <font color="red">**请勿携带内部流程信息（需求链接、问题单、内部issue等）**</font> - [ ] 需求 - [x] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 > 自定义cast算子注册流程跟torch pointwise算子保持一致 # 【资料变更】 > 不涉及 # 【接口变更】 > 不涉及 # 【功能验证】 > 构造strideshard+shard用例输入cast算子 > 新增测试用例看护，并补充测试自验证截图  # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [ ] 代码注释完备，正确记录错误日志 - [ ] 代码实现进行了返回值、空指针等校验 - [ ] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [ ] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31360	7 个月前
checkpoint	!9796 Add distributed checkpoint support Merge pull request !9796 from chuboning/master	2 年前
fsdp	AI assist developer for python dt third batch for master Co-authored-by: deepSeekya<chenzhihan6@huawei.com> # message auto-generated for no-merge-commit merge: !26524 merge master into master AI assist developer for python dt third batch for master Created-by: deepSeekya Commit-by: deepSeekya Merged-by: ascend-robot Description: 【合入说明】 AI辅助研发python dt测试用例生成。 【合入来源】 AI辅助研发需求 dt测试文件覆盖率提升。 See merge request: Ascend/pytorch!26524	11 个月前
fsdp2	!22804 add fsdp test case Merge pull request !22804 from zhangqiongwen/master_fsdp_test_case	1 年前
pipelining	!21486 add pp ut Merge pull request !21486 from 詹昊/master	1 年前
rpc	AI assist developer for python dt third batch for master Co-authored-by: deepSeekya<chenzhihan6@huawei.com> # message auto-generated for no-merge-commit merge: !26524 merge master into master AI assist developer for python dt third batch for master Created-by: deepSeekya Commit-by: deepSeekya Merged-by: ascend-robot Description: 【合入说明】 AI辅助研发python dt测试用例生成。 【合入来源】 AI辅助研发需求 dt测试文件覆盖率提升。 See merge request: Ascend/pytorch!26524	11 个月前
shmem	[SHMEM] support npu shmem Co-authored-by: wangchao430<wangchao430@huawei.com> # message auto-generated for no-merge-commit merge: !26027 merge v2.99.0_shmem1 into master [SHMEM] support npu shmem Created-by: wangchao430 Commit-by: wangchao430 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!26027	11 个月前
tensor	update matmul sharding strategy Co-authored-by: zhangguoguang<zhangguoguang2@huawei.com> # message auto-generated for no-merge-commit merge: !31142 merge update_matmul_sharding_strategy_master into master update matmul sharding strategy Created-by: zhangguoguang Commit-by: zhangguoguang Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 > <font color="red">**如有社区issue，请关联issue链接**</font>\ > <font color="red">**请勿携带内部流程信息（需求链接、问题单、内部issue等）**</font> - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 补齐matmul正向和反向sharding strategy，根据输入shape，列出所有可能的sharding方式 # 【资料变更】 不涉及 # 【接口变更】 不涉及 # 【功能验证】 新增7个UT用例看护，自验通过  # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31142	7 个月前
watchdog	!16207 Resolve testcase randomly stuck 30mins. Merge pull request !16207 from jiangpengfei/master	1 年前
test_all_to_all.py	enable internal format by default for hccl tests on A3 Co-authored-by: freezee<gengdongjie@huawei.com> # message auto-generated for no-merge-commit merge: !27441 merge master into master enable internal format by default for hccl tests on A3 Created-by: freezee Commit-by: freezee Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27441	10 个月前
test_all_to_all_single.py	!12133 alltoall_base add check "Split sizes dosen't match total dim 0 size" Merge pull request !12133 from wangchao147/master_problem	2 年前
test_allgather.py	enable internal format by default for hccl tests on A3 Co-authored-by: freezee<gengdongjie@huawei.com> # message auto-generated for no-merge-commit merge: !27441 merge master into master enable internal format by default for hccl tests on A3 Created-by: freezee Commit-by: freezee Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27441	10 个月前
test_allgather_base.py	!17764 Fixed the failed tests. Merge pull request !17764 from yuhaiyan/master-dev2	1 年前
test_allgather_into_tensor.py	enable internal format by default for hccl tests on A3 Co-authored-by: freezee<gengdongjie@huawei.com> # message auto-generated for no-merge-commit merge: !27441 merge master into master enable internal format by default for hccl tests on A3 Created-by: freezee Commit-by: freezee Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27441	10 个月前
test_allreduce.py	Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Co-authored-by: dairenjie<dairenjie@huawei.com> # message auto-generated for no-merge-commit merge: !31224 merge master_0302 into master Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Created-by: dairenjie Commit-by: dairenjie Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 1. 修改ProcessGroupHCCL内reduce类接口的实现，在pre函数添加input.mul_(factor)的调用（9处） 2. 修改getHcclReduceOp内处理premul_sum场景为sum # 【资料变更】 不涉及 # 【接口变更】 增加torch.distributed._make_hccl_premul_sum 和PT原生接口_make_nccl_premul_sum保持对等，已评审。 # 【功能验证】 修改/新增reduce算子premul_sum场景测试用例。 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31224	7 个月前
test_api_get_hcom_name.py	!13554 feature: get_hcom_name_api support get and not init hccl Merge pull request !13554 from yangxiaorun/master	2 年前
test_api_set_hcom_name.py	!13853 update _is_support_hccl_comm_name api Merge pull request !13853 from 关龙锋/cherry-pick-1724120059	2 年前
test_avoid_record_stream.py	[MULTI_STREAM_MEMORY_REUSE] Align CUDA, and in the AVOID_RECORD_STREAM scenario, fall back to the recordStream logic. Co-authored-by: wangchao430<wangchao430@huawei.com> # message auto-generated for no-merge-commit merge: !27239 merge v2.99.0_multistream into master [MULTI_STREAM_MEMORY_REUSE] Align CUDA, and in the AVOID_RECORD_STREAM scenario, fall back to the recordStream logic. Created-by: wangchao430 Commit-by: wangchao430 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27239	10 个月前
test_base_distributed.py	!7010 Rename test files: test_distributed/test_fsdp/test_rpc Merge pull request !7010 from yuhaiyan/master-dev2	2 年前
test_batch_isend_irecv.py	enable internal format by default for hccl tests on A3 Co-authored-by: freezee<gengdongjie@huawei.com> # message auto-generated for no-merge-commit merge: !27441 merge master into master enable internal format by default for hccl tests on A3 Created-by: freezee Commit-by: freezee Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27441	10 个月前
test_broadcast.py	enable internal format by default for hccl tests on A3 Co-authored-by: freezee<gengdongjie@huawei.com> # message auto-generated for no-merge-commit merge: !27441 merge master into master enable internal format by default for hccl tests on A3 Created-by: freezee Commit-by: freezee Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27441	10 个月前
test_c10d_functional_native.py	!15687 Support collectiveCoalesced. Merge pull request !15687 from jiangpengfei/master	1 年前
test_c10d_object_collectives.py	!13707 Involve with_comms in test_c10d_object_collectives.py Merge pull request !13707 from dilililiwhy/cherry-pick-1723529592	2 年前
test_coalesced_manager.py	check the size of tensors for alltoall Co-authored-by: tonglei<tonglei10@huawei.com> # message auto-generated for no-merge-commit merge: !29632 merge master into master check the size of tensors for alltoall Created-by: tongleicom Commit-by: tonglei Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!29632	8 个月前
test_comm_hook.py	!7891 add ut for torch.futures Merge pull request !7891 from 邵非凡/futures	2 年前
test_data_parallel.py	!22300 Add support for custom dtype Merge pull request !22300 from chuboning/master	1 年前
test_device.py	torch_npu.npu.Event inherits torch.Event, add GetPerStreamQueue in NPUGuardImpl's function Co-authored-by: zhaoyu<nanzhaogang@qq.com> # message auto-generated for no-merge-commit merge: !29825 merge event_stream into master torch_npu.npu.Event inherits torch.Event, add GetPerStreamQueue in NPUGuardImpl's function Created-by: zhaoyu65 Commit-by: zhaoyu Merged-by: ascend-robot Description: # 【合入来源】 > (如有)请关联需求文档/issue链接 - [x] 需求 event/stream等接口对齐社区接入逻辑 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 1、将torch_npu.npu.Event修改为torch.Event的子类，和pytorch原生代码行为保持一致； 2、实现NPUGuardImpl::uncheckedGetDevice()； 3、NPUGuardImpl::block()、destroyEvent()支持PerStreamQueue，参考NPUEvent； 4、优化NPUGuardImpl::synchronizeEvent()； # 【资料变更】 不涉及 # 【接口变更】 不涉及 # 【功能验证】 1、使用isinstance、issubclass方法校验torch_npu.npu.Event和torch.Event的关系； 2、验证单流单queue场景是否正常； # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!29825	8 个月前
test_device_mesh.py	TORCH MAIN SYNC : strategy/rule registration refactoring (DTensor) Co-authored-by: dilililiwhy<why.wuhuanyu@huawei.com> # message auto-generated for no-merge-commit merge: !28630 merge main_sync_20251202 into master TORCH MAIN SYNC : strategy/rule registration refactoring (DTensor) Created-by: dilililiwhy Commit-by: dilililiwhy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: 2.10.0.dev20251124 **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: https://github.com/pytorch/pytorch/pull/166264 https://github.com/pytorch/pytorch/pull/167782 https://github.com/pytorch/pytorch/pull/168221 See merge request: Ascend/pytorch!28630	9 个月前
test_distributed.py	Fixed skipIfUnsupportMultiNPU Co-authored-by: yuhaiyan<yuhaiyan8@huawei.com> # message auto-generated for no-merge-commit merge: !26456 merge cherry-pick-mr-26453-1762919457981-auto into master Fixed skipIfUnsupportMultiNPU Created-by: yuhaiyan Commit-by: yuhaiyan Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!26456	11 个月前
test_fault_mode.py	test(npu): add SupportedDevices decorator for test_fault_mode Co-authored-by: xftxyz<pangxiaoyu@h-partners.com> # message auto-generated for no-merge-commit merge: !32023 merge master-2603180 into master test(npu): add SupportedDevices decorator for test_fault_mode Created-by: xftxyz Commit-by: xftxyz Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 > <font color="red">**如有社区issue，请关联issue链接**</font>\ > <font color="red">**请勿携带内部流程信息（需求链接、问题单、内部issue等）**</font> - [ ] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 > 请描述修改内容的具体实现，涉及哪些组件之间进行交互，可以用1、2、3、...进行罗列\ > 如果是需求或者重构类的PR，需要补充详细设计文档（说明上下游组件关系、时序图、类图、DFX能力等内容） test/npu/test_fault_mode.py：Ascend950不支持aclop，为test_aclopCompile、test_ascyn这两个用例添加@SupportedDevices(['Ascend910A', 'Ascend910B', 'Ascend910_93'])装饰器 test/distributed/test_fault_mode.py：Ascend950日志字符串改变，为test_hccl_timeout用例添加@SupportedDevices(['Ascend910A', 'Ascend910B', 'Ascend910_93'])装饰器，并新增test_hccl_timeout_950，将断言修改为task timeout # 【资料变更】 > 请确认是否涉及资料变更。如涉及，需要在PR中体现，并简要说明修改内容。如不涉及，需填写“不涉及” # 【接口变更】 > 请确认是否涉及跨代码仓或者客户面可见的接口变更。如涉及，需要详细说明接口以及对应的变更内容，同时需要在资料中体现。如不涉及，需填写“不涉及” # 【功能验证】 > 说明测试场景，测试方法。如果本次测试方式与常规单元测试不同，请详细说明您的测试步骤\ > 新增/变更内容是否已新增/适配UT测试用例看护，并补充测试自验证截图 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!32023	7 个月前
test_flight_recorder.py	Skip flight_recorder test_hccl_timeout_dumps Co-authored-by: unknown<chenzihao65@huawei.com> # message auto-generated for no-merge-commit merge: !26956 merge timeout into master Skip flight_recorder test_hccl_timeout_dumps Created-by: gcw_5tF58QLT Commit-by: unknown Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug **What does this PR do / why do we need it**: skip problem test **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!26956	10 个月前
test_gather.py	!17048 bugfix for ddp ut Merge pull request !17048 from 邵非凡/dptest	1 年前
test_get_p2p_stream_id.py	feat: add get_p2p_stream_id interface for HCCL backend Co-authored-by: pengjingyou<pengjingyou@huawei.com> # message auto-generated for no-merge-commit merge: !32199 merge p2p_stream_master into master feat: add get_p2p_stream_id interface for HCCL backend Created-by: pengjingyou Commit-by: pengjingyou Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 > <font color="red">**如有社区issue，请关联issue链接**</font>\ > <font color="red">**请勿携带内部流程信息（需求链接、问题单、内部issue等）**</font> - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 为 HCCL 后端新增 get_p2p_stream_id 接口，用于获取 P2P 通信的 NPU stream ID，方便用户在分布式训练场景下进行 stream 级别的同步和管理。 # 【修改方案】 1. 新增 C++ 方法 getP2PStreamId 在 ProcessGroupHCCL 类中新增 getP2PStreamId 方法，支持两种模式： - 批量模式 (is_batched=1) ：使用 getKeyFromDevices 生成 key，适用于 batch_isend_irecv 场景 - 非批量模式 (is_batched=0) ：使用 getKeySendRecv 生成 key，适用于单独的 send/recv 场景 2. 新增 Python 绑定 在 Init.cpp 中添加 Python 绑定，暴露 get_p2p_stream_id 接口到 Python 层 # 【资料变更】 > 请确认是否涉及资料变更。如涉及，需要在PR中体现，并简要说明修改内容。如不涉及，需填写“不涉及” # 【接口变更】 | 接口名称 | 参数 | 返回值 | 说明 | | ---------------------------------- | ------------------------------------------------------------ | -------------------------------- | ------------------------- | | ProcessGroupHCCL.get_p2p_stream_id | device: torch.device - NPU <br>设备 peer: int - 对端 rank <br>is_batched: int - 是否批量模式 (1=批量, 0=非批量) | int - stream ID，不存在时返回 -1 | 获取 P2P 通信的 stream ID | # 【功能验证】 1. ut验证 新增测试文件 test/distributed/test_get_p2p_stream_id.py ，包含以下测试场景： | 测试用例 | 说明 | | ------------------------------ | ---------------------------------------------- | | test_p2p_stream_id_batched | 测试批量模式 (is_batched=1) 下获取 stream ID | | test_p2p_stream_id_non_batched | 测试非批量模式 (is_batched=0) 下获取 stream ID | | test_p2p_stream_id_invalid | 测试未构造p2p stream场景下获取 stream ID 非法值-1 | python -m pytest test/distributed/test_get_p2p_stream_id.py  2. 业务场景验证 调用dist.send/recv方法进行p2p通信后，通过该新增接口get_p2p_stream_id()获取p2p stream id，拿到id对应的Stream实例，指定在该Stream上进行计算操作。 通过profiling文件可以看到计算在p2p stream上进行  # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!32199	7 个月前
test_hccl_shared_buffer.py	syncop now work on current stream during collective Co-authored-by: wanghonghao<wanghonghao9@huawei.com> # message auto-generated for no-merge-commit merge: !28492 merge master_syncop into master syncop now work on current stream during collective Created-by: wanghonghao Commit-by: wanghonghao Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: /kind feature **What does this PR do / why do we need it**: syncop now work on current stream during collective **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!28492	9 个月前
test_hccl_stream_id.py	!23272 set default streampool to 32 Merge pull request !23272 from SCh-zx/streamm	1 年前
test_inductor_collectives.py	!12069 [feature]Support Functional Collectives Merge pull request !12069 from 叶子凡/master_functional_collectives	2 年前
test_multi_accelerator.py	!21271 [3/N] Add multi accelerator cases Merge pull request !21271 from dilililiwhy/add_multi_accelerator_cases	1 年前
test_nslb.py	!16593 Fix Path Manager For Security Merge pull request !16593 from 周先琪/master_zxq	1 年前
test_options.py	request for hccl qos Co-authored-by: gcw_Dgfy2aKk<dujunjie2@huawei.com> # message auto-generated for no-merge-commit merge: !30434 merge Hccl_Qos_master into master request for hccl qos Created-by: gcw_Dgfy2aKk Commit-by: gcw_Dgfy2aKk Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 > (如有)请关联需求文档/issue链接 SR20260122924103 https://portal.libing.huawei.com/apps/21/6900108a-78fd-4741-bd29-39eae2207009?otherQuery=%257B%2522designerDesktopPath%2522%253A%2522featureRequirement%2522%252C%2522featureRequirementCon%2522%253A%257B%2522SF%2522%253A%257B%2522fields%2522%253A%257B%257D%252C%2522filterData%2522%253A%257B%257D%257D%252C%2522All%2522%253A%257B%2522fields%2522%253A%257B%257D%252C%2522filterData%2522%253A%257B%257D%257D%252C%2522searchValue%2522%253A%2522SR20260122924103%2522%257D%252C%2522rid%2522%253A%25222096456495%2522%257D - [x] 需求 # 【修改方案】 透传hccl qos参数给HCCL # 【资料变更】 不涉及 # 【接口变更】 不涉及 # 【功能验证】 执行 python test/distributed/test_options.py -k test_options_hccl_sdma_qos_wrong_type 执行结果： 执行通过， 无报错 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!30434	8 个月前
test_parallel_store.py	!16974 parallel tcpstore support tiered optimizer Merge pull request !16974 from wuxiaotong/cherry-pick-1734348942	1 年前
test_parallel_store_tiered_optimizer.py	!16974 parallel tcpstore support tiered optimizer Merge pull request !16974 from wuxiaotong/cherry-pick-1734348942	1 年前
test_pin_memory.py	!14369 don't change current device when pin_memory=True Merge pull request !14369 from huangyunlong/2.5pin	2 年前
test_reduce.py	Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Co-authored-by: dairenjie<dairenjie@huawei.com> # message auto-generated for no-merge-commit merge: !31224 merge master_0302 into master Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Created-by: dairenjie Commit-by: dairenjie Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 1. 修改ProcessGroupHCCL内reduce类接口的实现，在pre函数添加input.mul_(factor)的调用（9处） 2. 修改getHcclReduceOp内处理premul_sum场景为sum # 【资料变更】 不涉及 # 【接口变更】 增加torch.distributed._make_hccl_premul_sum 和PT原生接口_make_nccl_premul_sum保持对等，已评审。 # 【功能验证】 修改/新增reduce算子premul_sum场景测试用例。 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31224	7 个月前
test_reduce_scatter.py	Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Co-authored-by: dairenjie<dairenjie@huawei.com> # message auto-generated for no-merge-commit merge: !31224 merge master_0302 into master Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Created-by: dairenjie Commit-by: dairenjie Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 1. 修改ProcessGroupHCCL内reduce类接口的实现，在pre函数添加input.mul_(factor)的调用（9处） 2. 修改getHcclReduceOp内处理premul_sum场景为sum # 【资料变更】 不涉及 # 【接口变更】 增加torch.distributed._make_hccl_premul_sum 和PT原生接口_make_nccl_premul_sum保持对等，已评审。 # 【功能验证】 修改/新增reduce算子premul_sum场景测试用例。 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31224	7 个月前
test_reduce_scatter_base.py	Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Co-authored-by: dairenjie<dairenjie@huawei.com> # message auto-generated for no-merge-commit merge: !31224 merge master_0302 into master Add PREMUL_SUM support in ProcessGroupHCCL for ReduceOp Created-by: dairenjie Commit-by: dairenjie Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 1. 修改ProcessGroupHCCL内reduce类接口的实现，在pre函数添加input.mul_(factor)的调用（9处） 2. 修改getHcclReduceOp内处理premul_sum场景为sum # 【资料变更】 不涉及 # 【接口变更】 增加torch.distributed._make_hccl_premul_sum 和PT原生接口_make_nccl_premul_sum保持对等，已评审。 # 【功能验证】 修改/新增reduce算子premul_sum场景测试用例。 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31224	7 个月前
test_reduce_scatter_tensor.py	[feat] custom hccl api with dispatch Co-authored-by: pengqi<pengqi33@huawei.com> # message auto-generated for no-merge-commit merge: !31307 merge master into master [feat] custom hccl api with dispatch Created-by: pengqihw Commit-by: pengqi Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> 为自定义HCCL分布式API添加AsyncCollectiveTensor支持，实现自动wait触发机制。 # 【合入来源】 > <font color="red">**如有社区issue，请关联issue链接**</font>\ > <font color="red">**请勿携带内部流程信息（需求链接、问题单、内部issue等）**</font> - [x] 需求 - [ ] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 1. 新增文件 - test/distributed/test_async_collective_tensor.py - 新增测试用例，验证三个API对AsyncCollectiveTensor的支持 - torch_npu/csrc/distributed/HcclOps.cpp - 新增HCCL操作实现 2. 核心修改 - ProcessGroupHCCL.cpp/hpp - 为以下API添加dispatch机制，支持AsyncCollectiveTensor自动触发wait： - batch_isend_irecv - reduce_scatter_tensor_uneven - all_gather_into_tensor_uneven 3. 其他修改 - test/distributed/test_reduce_scatter_tensor.py - 测试用例调整 - torch_npu_schema.json - schema更新 - Init.cpp - 初始化相关调整 # 【资料变更】 不涉及 # 【接口变更】 不涉及 # 【功能验证】 # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [ ] 代码注释完备，正确记录错误日志 - [ ] 代码实现进行了返回值、空指针等校验 - [ ] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [ ] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31307	7 个月前
test_register_sharding.py	Fix UT from test_register_sharding Co-authored-by: zhangguoguang<zhangguoguang2@huawei.com> # message auto-generated for no-merge-commit merge: !29145 merge fix_UT_master into master Fix UT from test_register_sharding Created-by: zhangguoguang Commit-by: zhangguoguang Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!29145	9 个月前
test_rendezvous.py	AI assist developer for python DT second batch for master Co-authored-by: deepSeekya<chenzhihan6@huawei.com> # message auto-generated for no-merge-commit merge: !26387 merge master into master AI assist developer for python DT second batch for master Created-by: deepSeekya Commit-by: deepSeekya Merged-by: ascend-robot Description: 【合入说明】 AI辅助研发python dt测试用例生成。 【合入来源】 AI辅助研发需求 dt测试文件覆盖率提升。 See merge request: Ascend/pytorch!26387	11 个月前
test_run.py	AI assist developer for python DT second batch for master Co-authored-by: deepSeekya<chenzhihan6@huawei.com> # message auto-generated for no-merge-commit merge: !26387 merge master into master AI assist developer for python DT second batch for master Created-by: deepSeekya Commit-by: deepSeekya Merged-by: ascend-robot Description: 【合入说明】 AI辅助研发python dt测试用例生成。 【合入来源】 AI辅助研发需求 dt测试文件覆盖率提升。 See merge request: Ascend/pytorch!26387	11 个月前
test_scatter.py	!19882 fix reduce_scatter_with_different_shape_avg Merge pull request !19882 from zhangqiongwen/master_avg_fix	1 年前
test_send_recv.py	enable internal format by default for hccl tests on A3 Co-authored-by: freezee<gengdongjie@huawei.com> # message auto-generated for no-merge-commit merge: !27441 merge master into master enable internal format by default for hccl tests on A3 Created-by: freezee Commit-by: freezee Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27441	10 个月前
test_silent_check.py	!18801 SilentCheck: Add false detection test case for broadcast. Merge pull request !18801 from 王超/v2.7.0_silentbroadcast	1 年前
test_watchdog.py	!13113 Remove judgement of done in watchdog to slove the stucking problem of error exit Merge pull request !13113 from jiangpengfei/master	2 年前
test_with_device.py	fix ignore it when device_index < 0 on with device Co-authored-by: huangyunlong2022<huangyunlong4@h-partners.com> # message auto-generated for no-merge-commit merge: !31938 merge 2.11wt into master fix ignore it when device_index < 0 on with device Created-by: huangyunlong2022 Commit-by: huangyunlong2022 Merged-by: ascend-robot Description: <!-- PR描述模板更新日期：20260203 --> # 【合入来源】 > <font color="red">**如有社区issue，请关联issue链接**</font>\ > <font color="red">**请勿携带内部流程信息（需求链接、问题单、内部issue等）**</font> - [ ] 需求 - [x] 问题单 - [ ] issue/工单 - [ ] 重构优化 - [ ] 资料更新 # 【修改方案】 > 请描述修改内容的具体实现，涉及哪些组件之间进行交互，可以用1、2、3、...进行罗列\ > 如果是需求或者重构类的PR，需要补充详细设计文档（说明上下游组件关系、时序图、类图、DFX能力等内容） 修复with torch.npu.deivice，传-1时，会set device 0的问题，当前对于传入异常参数（小于0）不做处理 # 【资料变更】 > 请确认是否涉及资料变更。如涉及，需要在PR中体现，并简要说明修改内容。如不涉及，需填写“不涉及” # 【接口变更】 > 请确认是否涉及跨代码仓或者客户面可见的接口变更。如涉及，需要详细说明接口以及对应的变更内容，同时需要在资料中体现。如不涉及，需填写“不涉及” # 【功能验证】 > 说明测试场景，测试方法。如果本次测试方式与常规单元测试不同，请详细说明您的测试步骤\ > 新增/变更内容是否已新增/适配UT测试用例看护，并补充测试自验证截图  # 【CheckList】 > PR提交人对以下CheckList自检项进行全量自检，自检通过或不涉及，均修改 [ ] 为 [x] - [x] 代码注释完备，正确记录错误日志 - [x] 代码实现进行了返回值、空指针等校验 - [x] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!31938	7 个月前
test_zero_redundancy_optimizer.py	register strategies for npu custom ops Co-authored-by: jizewei<jizewei@huawei.com> # message auto-generated for no-merge-commit merge: !27012 merge master_register_strategy into master register strategy for npu custom ops Created-by: jizewei Commit-by: jizewei Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature /kind feature **What does this PR do / why do we need it**: register sharding strategies for npu custom ops to support DTensor: 1. npu_add_rms_norm 2. npu_moe_token_permute, npu_moe_token_permute_grad 3. npu_moe_token_unpermute, npu_moe_token_unpermute_grad 4. npu_rotary_mul, npu_rotary_mul_backward **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!27012	10 个月前