| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
feat(pytorch): refactor fsdp2 ckpt converter Co-authored-by: HanhuiChen<chenhanhui1@h-partners.com> # message auto-generated for no-merge-commit merge: !4568 merge bugfix into master feat(pytorch): refactor fsdp2 ckpt converter Created-by: HANHU1CHEN Commit-by: HanhuiChen Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR adds a weight conversion utility for the MiniMax-M2.7 model that converts its FP8-quantized HuggingFace checkpoint into BF16 format, so the weights can be loaded and used on Ascend NPU. ## Does this PR introduce any user-facing change? No change to existing functionality. ## How was this patch tested? Verified by running the script on a MiniMax-M2.7 FP8 checkpoint and confirming the output directory loads correctly and produces the expected BF16 weights with the fused MoE layout. See merge request: Ascend/MindSpeed-LLM!4568 | 2 个月前 | |
feat(pytorch): add glm52 in fsdp2 Co-authored-by: guozhihua2<guozhihua2@huawei.com> # message auto-generated for no-merge-commit merge: !4614 merge add_glm52_in_fsdp2 into master feat(pytorch): add glm52 in fsdp2 Created-by: guozhihua2 Commit-by: guozhihua2 Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR adds GLM52 model support in the FSDP2 training framework. Main changes include: 1. Add the GLM52 model implementation for FSDP2, including model definition, configuration adaptation, and registration logic. 2. Support GLM52 pretraining under the FSDP2 framework, enabling users to launch GLM52 training with the FSDP2 training entry and related scripts. 3. Support GLM52 chat/inference flow, so the adapted GLM52 model can be used for basic generation and chat validation after loading. 4. Adapt GLM52-specific model logic in FSDP2, including attention/indexer-related behavior and model forward compatibility required by GLM52. 5. Provide related ST coverage to ensure the GLM52 FSDP2 model path can be built, loaded, and executed correctly. ## Does this PR introduce any user-facing change? Yes. Users can now use the GLM52 model in the FSDP2 framework, including GLM52 pretraining and chat/inference workflows. Existing model usage is not expected to be affected. ## How was this patch tested？ Verified by running the GLM52 ST test. pipeline/st/glm52/pretrain_glm52_38b_4k_fsdp2_A3.sh The test covers the GLM52 FSDP2 model build and execution path, including pretraining-related runtime validation and basic chat/inference functionality. See merge request: Ascend/MindSpeed-LLM!4614 | 2 个月前 | |
feat(debug): support msProbe and model I/O tracing for FSDP2 and Megatron Co-authored-by: wj<wangjin230@huawei.com> # message auto-generated for no-merge-commit merge: !4878 merge fsdp2-msprobe into master feat(debug): support msProbe and model I/O tracing for FSDP2 and Megatron Created-by: gcw_RxnYoBVv Commit-by: wj Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR adds optional precision-data collection support for both FSDP2 and Megatron training backends. ## Does this PR introduce any user-facing change? Yes. The feature is disabled by default and does not affect existing training jobs unless explicitly enabled. For FSDP2, users can configure the features in the training YAML: yaml training: msprobe: true msprobe_config_path: /absolute/path/to/msprobe_config.json model_io_trace: true model_io_trace_config_path: /absolute/path/to/model_io_trace_config.json For Megatron, the corresponding arguments are: bash --msprobe \ --msprobe-config-path /absolute/path/to/msprobe_config.json \ --model-io-trace \ --model-io-trace-config-path /absolute/path/to/model_io_trace_config.json Related documentation: - docs/zh/pytorch/tools/msprobe.md - docs/zh/pytorch/tools/model_io_trace.md - docs/zh/pytorch/features/fsdp2/arguments.md ## How was this patch tested? After enabling the function, can the relevant files be generated after the training script is completed See merge request: Ascend/MindSpeed-LLM!4878 | 4 天前 | |
docs: fix doc ci reported error Co-authored-by: xuwenyue<xuwenyue1@huawei.com> # message auto-generated for no-merge-commit merge: !4585 merge fix_docci_0610 into master docs: fix doc ci reported error Created-by: xuwenyue Commit-by: xuwenyue Merged-by: ascend-robot Description: ## What this PR does / why we need it? fix doc ci reported error，include markdownlint，tag-closed-check ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA See merge request: Ascend/MindSpeed-LLM!4585 | 2 个月前 | |
fix(pytorcch): fix describe of replace_ascend_path Co-authored-by: qyzqyz<quyueze@h-partners.com> # message auto-generated for no-merge-commit merge: !4626 merge master into master fix(pytorcch): fix describe of replace_ascend_path Created-by: qyzqyz Commit-by: qyzqyz Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR adds a global tool to change the HDK path. The tool allows users to easily switch or configure the HDK installation directory across the project, improving flexibility for environments where HDK is installed in non-standard locations. ## Does this PR introduce any user-facing change? This PR allows users to set/change the HDK path globally . Users can now specify a custom HDK path via this tool instead of manually modifying environment variables or configuration files. ## How was this patch tested? Manually tested the tool by setting different HDK paths and verifying that the environment variables and configurations are updated correctly. See merge request: Ascend/MindSpeed-LLM!4626 | 2 个月前 | |
chore(pytorch)：add the script to obtain environment version information. Co-authored-by: yanzhixiao<yanzhixiao@h-partners.com> # message auto-generated for no-merge-commit merge: !4404 merge add-env-tools into master chore(pytorch)：add the script to obtain environment version information. Created-by: yanzhixiao23 Commit-by: yanzhixiao Merged-by: ascend-robot Description: ## What this PR does / why we need it? Add a script to obtain environment version information. ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA See merge request: Ascend/MindSpeed-LLM!4404 | 4 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 2 个月前 | ||
| 2 个月前 | ||
| 4 天前 | ||
| 2 个月前 | ||
| 2 个月前 | ||
| 4 个月前 |