Yyangzhenzhang02refactor: 去除 platform 抽象，改用 torch 原生接口
| Files | Last commit | Last update |
|---|---|---|
fix codecheck and fix optim state name in ActivationWrapper | 1 month ago | |
| 1 month ago | ||
refactor: 去除 platform 抽象，改用 torch 原生接口 删除 hyper_parallel/platform/ 整个双后端抽象层，相关实现直接使用 torch 原生接口；仅保留的 Torch-only 组件迁至 components/。 主要变更： - 删除 hyper_parallel/platform/**（mindspore 后端、platform.py、 swap_optimizer、activation_checkpoint、loss_parallel_ops、 function_override、init_weights 等） - hyper_parallel/platform/torch/common/moe.py 重命名至 hyper_parallel/components/modules/moe.py（内容不变），并同步更新 examples/torch、tests/torch、核心模块中的 20 余处 import - hyper_parallel/__init__.py 移除 get_platform 导出 - destroy_process_group 中 _P2P_MULTI_STREAM_GROUPS 改从 hyper_parallel.core.pipeline_parallel._p2p 导入 - 删除 examples/mindspore/**、tests/ut/platform/** - scripts/pylint_hyperparallel.py：PLATFORM_ALLOWED_PARTS 移除 hyper_parallel/platform/；删除 instance-platform-assignment (C9003) 规则 - 更新 .agent 规则、docs、docker、CODEOWNERS 等配套内容 327 files changed, 648 insertions(+), 20321 deletions(-) | 1 month ago | |
refactor!: reorganize auto_models into top-level models/components/distributed/trainer/data Squashed 58 commits of the AutoModels directory restructure (M0-M5, S4a-S8d, top-level split): - characterization tests first (M0): UT collection baseline, public API contract snapshots, build-order golden cases, shared fixtures, training YAML snapshots - distributed split (S4a-S4g): sharding_config/planner/applier/injection split into distributed/{plan,recipe_spec,apply,compile, activation_checkpoint} + private _builder/; CP/EP into context_parallel/ and expert_parallel/; fsdp2 into fsdp_adapter + source_shard - models adapter layer (M1-M5): adapter_spec/registry skeleton, Qwen3-MoE replacements and CP/EP contracts migrated into models/qwen3_moe/adapter, single recipe converged onto models/qwen3_moe/recipes/train.yaml, legacy fusion files deleted; per-family sharding_rules declared via ModelAdapterSpec with directory-convention auto-discovery registration - build pipeline (S5a-S5g): checkpoint finalization into checkpoint_loader, plan DTO boundary normalized, god module split into model_builder, registry split into config_resolver + models/registry - data stack (S6a-S6f): indexed/text/online/batching/parallel/vlm/tools migrated to top-level hyper_parallel/data - trainer (S7a-S7e): config tree/callbacks/runtime/base+text+vlm migrated to top-level hyper_parallel/trainer, utils split eliminated - closeout (S8a-S8d): legacy core/shard API, legacy hyper_parallel/models and components compatibility package deleted; import boundary gates - top-level split: auto_models/ dissolved into models/ (adapter layer + api/build_options/replacement/_transformers, external interface), components/ (modules/functional/quantization/losses/optim/checkpoint) and distributed/; references rewritten across py/yaml/sh and setup.py; boundary gates updated (distributed -> models limited to the build_options leaf DTO plus the planner's function-level registry lookup) Verified: full UT 4562 passed / 39 failed (identical to the pre-refactor environment-failure baseline), characterization suites green. | 2 months ago | |
feat: add chunked causal language model loss | 2 months ago | |
refactor!: reorganize auto_models into top-level models/components/distributed/trainer/data Squashed 58 commits of the AutoModels directory restructure (M0-M5, S4a-S8d, top-level split): - characterization tests first (M0): UT collection baseline, public API contract snapshots, build-order golden cases, shared fixtures, training YAML snapshots - distributed split (S4a-S4g): sharding_config/planner/applier/injection split into distributed/{plan,recipe_spec,apply,compile, activation_checkpoint} + private _builder/; CP/EP into context_parallel/ and expert_parallel/; fsdp2 into fsdp_adapter + source_shard - models adapter layer (M1-M5): adapter_spec/registry skeleton, Qwen3-MoE replacements and CP/EP contracts migrated into models/qwen3_moe/adapter, single recipe converged onto models/qwen3_moe/recipes/train.yaml, legacy fusion files deleted; per-family sharding_rules declared via ModelAdapterSpec with directory-convention auto-discovery registration - build pipeline (S5a-S5g): checkpoint finalization into checkpoint_loader, plan DTO boundary normalized, god module split into model_builder, registry split into config_resolver + models/registry - data stack (S6a-S6f): indexed/text/online/batching/parallel/vlm/tools migrated to top-level hyper_parallel/data - trainer (S7a-S7e): config tree/callbacks/runtime/base+text+vlm migrated to top-level hyper_parallel/trainer, utils split eliminated - closeout (S8a-S8d): legacy core/shard API, legacy hyper_parallel/models and components compatibility package deleted; import boundary gates - top-level split: auto_models/ dissolved into models/ (adapter layer + api/build_options/replacement/_transformers, external interface), components/ (modules/functional/quantization/losses/optim/checkpoint) and distributed/; references rewritten across py/yaml/sh and setup.py; boundary gates updated (distributed -> models limited to the build_options leaf DTO plus the planner's function-level registry lookup) Verified: full UT 4562 passed / 39 failed (identical to the pre-refactor environment-failure baseline), characterization suites green. | 2 months ago | |
feat: add chunked causal language model loss | 2 months ago | |
fix: apply targeted memory and correctness fixes | 1 month ago |