Yyangzhenzhang02chore: purge MindSpore residue after backend removal
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
refactor(dtensor): remove dead code and fix static check warnings Delete unreachable async wrappers, the sync-hook autograd function (now in pipeline_parallel/_sync_hook.py) and their orphaned helpers. Extract a stage reporting helper and add docstrings so the touched functions stay within the local-variable and protected-access limits. Refs: #242 | 1 个月前 | |
feat: add CommDebugMode for DTensor op and collective communication tracing | 3 个月前 | |
refactor(dtensor): 解耦 DTensor 核心模块与 platform 层依赖 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> | 1 个月前 | |
refactor(dtensor): 解耦 DTensor 核心模块与 platform 层依赖 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> | 1 个月前 | |
style: clean low-risk code warnings | 4 个月前 | |
refactor(dtensor): 解耦 DTensor 核心模块与 platform 层依赖 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> | 1 个月前 | |
chore: purge MindSpore residue after backend removal The platform abstraction layer (and with it the MindSpore backend) was deleted earlier, but references to it survived throughout the tree. This removes them; it changes no behavior on the surviving Torch path. Removed: - docker/Dockerfile.mindspore, the MindSpore build branch and examples in docker/build_hyper-parallel_npu.sh / docker/README.md - .jenkins/test/config/dependent_packages.yaml (a single MindSpore wheel URL with no remaining consumer) - MindSporeCase in tests/common/parallel_case.py and msrun_case in tests/common/distributed_launcher.py, plus msrun / MS_NODE_ID rank-discovery fallbacks - dead _MS_PRIMITIVE_OP_NAMES branches in the shard ops (none of those op names are registered in any yaml) and their tests - the stale aclop packed-args notes in parallel_elementwise.py / parallel_gather.py (_normalize_aclop_args no longer exists) - three pylint errors the Atomgit gate reports on files this commit already touches: an unused os import in _pytorch_reference.py, a missing docstring on NoAcceleratorGuard._check_init_process_group and trailing blank lines in test_parallel_topk.py - mindspore from the multicore boundary test, pylint's generated-members, from the autogit lint backend list and from the docs, examples and .agent rules Kept on purpose: - _MS_POSITIONAL_DTYPE_OP_NAMES in parallel_reduce.py — SumExt / MeanExt are live torch registrations in torch_reduce.yaml, so the trailing positional dtype slot is still reachable - test_runtime_sources_import_no_platform_layer — the boundary test still asserts production sources import no Platform layer - URLs under the project's own mindspore.org / gitcode / atomgit namespaces, including the links to the MindSpore repo's contribution rules - hyper_parallel_v1.0.0_release_notes.md (historical) | 1 个月前 | |
fix: clean master static analysis warnings | 1 个月前 | |
chore: purge MindSpore residue after backend removal The platform abstraction layer (and with it the MindSpore backend) was deleted earlier, but references to it survived throughout the tree. This removes them; it changes no behavior on the surviving Torch path. Removed: - docker/Dockerfile.mindspore, the MindSpore build branch and examples in docker/build_hyper-parallel_npu.sh / docker/README.md - .jenkins/test/config/dependent_packages.yaml (a single MindSpore wheel URL with no remaining consumer) - MindSporeCase in tests/common/parallel_case.py and msrun_case in tests/common/distributed_launcher.py, plus msrun / MS_NODE_ID rank-discovery fallbacks - dead _MS_PRIMITIVE_OP_NAMES branches in the shard ops (none of those op names are registered in any yaml) and their tests - the stale aclop packed-args notes in parallel_elementwise.py / parallel_gather.py (_normalize_aclop_args no longer exists) - three pylint errors the Atomgit gate reports on files this commit already touches: an unused os import in _pytorch_reference.py, a missing docstring on NoAcceleratorGuard._check_init_process_group and trailing blank lines in test_parallel_topk.py - mindspore from the multicore boundary test, pylint's generated-members, from the autogit lint backend list and from the docs, examples and .agent rules Kept on purpose: - _MS_POSITIONAL_DTYPE_OP_NAMES in parallel_reduce.py — SumExt / MeanExt are live torch registrations in torch_reduce.yaml, so the trailing positional dtype slot is still reachable - test_runtime_sources_import_no_platform_layer — the boundary test still asserts production sources import no Platform layer - URLs under the project's own mindspore.org / gitcode / atomgit namespaces, including the links to the MindSpore repo's contribution rules - hyper_parallel_v1.0.0_release_notes.md (historical) | 1 个月前 | |
refactor(dtensor): 抽取平台无关 DTensorBase 到 core DTensor 只支持 torch 平台，无需再经 platform 层屏蔽平台差异。 - 新增 core/dtensor/dtensor_base.py，承载原 platform/torch/dtensor.py 的 DTensorBase 实现 - 删除 platform/torch/dtensor.py 与 platform/mindspore/dtensor.py， 并移除 TorchPlatform / MindSporePlatform 上的 DTensorBase 属性 - 清理 MindSporePlatform 中永不成立的 isinstance(param, DTensorBase) 分支（平台层只会拿到 ms.Parameter，不会接触 DTensor） - 用例：data 描述符测试迁至 tests/ut/core/dtensor/test_dtensor_base.py， _ensure_contiguous 的 torch 部分迁至 tests/ut/platform/torch/dtensor/， 删除依赖已移除实现的 tests/ut/platform/mindspore/dtensor/ - 同步 .agent 下指向旧路径的文档 | 1 个月前 | |
refactor(dtensor): 解耦 DTensor 核心模块与 platform 层依赖 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> | 1 个月前 | |
Merge pull request #944 from mxysfive/clean_code_mxy cleancode: fix lint errors | 1 个月前 | |
refactor(dtensor): 解耦 DTensor 核心模块与 platform 层依赖 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> | 1 个月前 | |
feat: support fsdp uneven_shard & support dualmode_trainer & refactor | 2 个月前 | |
refactor(dtensor): 解耦 DTensor 核心模块与 platform 层依赖 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> | 1 个月前 | |
refactor: fix pylint warnings across dtensor, shard, and platform modules 修复 12 个 pylint 告警： - G.CLS.07: 为 7 个不使用 self 的方法添加 @staticmethod 装饰器 - G.EXP.02: 将多行 lambda 提取为命名函数 _reduce_pair_sort_key - G.NAM.05: 为框架调度钩子 __torch_function__ 和 __fallback__ 添加 pylint disable - G.CTL.03: 将复杂 if 条件提取为命名变量 in_dim_matches_out_prefix - 圈复杂度: 从 custom_shard.wrapped() 提取辅助函数降低复杂度 refactor: fix pylint warnings across dtensor, shard, and platform modules 修复 12 个 pylint 告警： - G.CLS.07: 为 7 个方法添加 @staticmethod 装饰器 - G.EXP.02: 将多行 lambda 提取为命名函数 - G.NAM.05: 为 __torch_function__ 和 __fallback__ 添加 pylint disable - G.CTL.03: 将复杂 if 条件提取为命名变量 - 圈复杂度: 从 wrapped() 提取辅助函数降低复杂度 修改文件: tensor_redistribution.py, custom_shard.py, redistribute_infer.py, _op_dispatch.py, mindspore/dtensor.py, torch/dtensor.py | 4 个月前 | |
refactor: consolidate core collectives and helpers into core/utils 本 PR 对 hyper_parallel/core 做去重整理,把原先散落在 dtensor 与 distributed 两处的集体通信函数和小工具收敛到单一归属模块,消除重复 实现与重导出链。 - core/utils/communication.py:新增 get_group_local_rank、get_device_handle、 get_world_size、ensure_contiguous、create_group、split_group、 init_process_group 等设备/进程组工具,以及 differentiable_* 系列集体通信 函数与 p2p_exchange、wait_async_tensor。 - core/utils/__init__.py:补充对外导出,使 core.utils 成为这些公共工具的 唯一入口。 - hyper_parallel/distributed/_collectives.py:删除,其内容已并入 core/utils/communication.py。 - core/dtensor/_utils.py:移除已迁至 core.utils 的重复实现,仅保留调试 tracer 需要在本模块上打补丁的绑定。 - core/context_parallel/utils.py、core/fully_shard/utils.py、 core/shard/utils.py、core/activation_memory/_backend.py:统一以 __all__ 声明对外可见符号,替代 from x import y as y 的显式重导出写法,并清除 无消费者的冗余导入。 - core/shard/utils.py:删除 get_world_size 封装(torch 原生接口已可直接 调用),调用点 shard/api.py 与 fully_shard/api.py 改用 dist.get_world_size()。 - distributed/{_builder,context_parallel}:同步适配新的导入路径。 不再有同名的重复实现,调用方从 core.utils 取用;tracer 依赖的模块级绑定 保持不变。行为无变化。 | 1 个月前 |