| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
fix: add qkv_split per_group for qwen25 and qwen2 moe Co-authored-by: wanggangguo<wanggangguo@huawei.com> # message auto-generated for no-merge-commit merge: !4693 merge debug5 into master fix: add qkv_split per_group for qwen25 and qwen2 moe Created-by: isfrapples Commit-by: wanggangguo Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. Fix qkv unpack mismatch between hf2mg packing and mg2hf splitting. 2. Add qkv_split: per_group to qwen25 and qwen2-moe configs. ## Does this PR introduce any user-facing change? 1. No, it only fixes an internal checkpoint conversion bug. 2. All existing interfaces and behaviors remain unchanged. ## How was this patch tested? 1. Run test_qwen25_hf2mcore_tp4pp2dpp and test_qwen25_mcore2hf_tp4pp2dpp successfully. 2. Both roundtrip and direct mcore2hf weight comparisons now pass. fixes#1573 See merge request: Ascend/MindSpeed-LLM!4693 | 1 个月前 | |
fix: add qkv_split per_group for qwen25 and qwen2 moe Co-authored-by: wanggangguo<wanggangguo@huawei.com> # message auto-generated for no-merge-commit merge: !4693 merge debug5 into master fix: add qkv_split per_group for qwen25 and qwen2 moe Created-by: isfrapples Commit-by: wanggangguo Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. Fix qkv unpack mismatch between hf2mg packing and mg2hf splitting. 2. Add qkv_split: per_group to qwen25 and qwen2-moe configs. ## Does this PR introduce any user-facing change? 1. No, it only fixes an internal checkpoint conversion bug. 2. All existing interfaces and behaviors remain unchanged. ## How was this patch tested? 1. Run test_qwen25_hf2mcore_tp4pp2dpp and test_qwen25_mcore2hf_tp4pp2dpp successfully. 2. Both roundtrip and direct mcore2hf weight comparisons now pass. fixes#1573 See merge request: Ascend/MindSpeed-LLM!4693 | 1 个月前 | |
fix: add qkv_split per_group for qwen25 and qwen2 moe Co-authored-by: wanggangguo<wanggangguo@huawei.com> # message auto-generated for no-merge-commit merge: !4693 merge debug5 into master fix: add qkv_split per_group for qwen25 and qwen2 moe Created-by: isfrapples Commit-by: wanggangguo Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. Fix qkv unpack mismatch between hf2mg packing and mg2hf splitting. 2. Add qkv_split: per_group to qwen25 and qwen2-moe configs. ## Does this PR introduce any user-facing change? 1. No, it only fixes an internal checkpoint conversion bug. 2. All existing interfaces and behaviors remain unchanged. ## How was this patch tested? 1. Run test_qwen25_hf2mcore_tp4pp2dpp and test_qwen25_mcore2hf_tp4pp2dpp successfully. 2. Both roundtrip and direct mcore2hf weight comparisons now pass. fixes#1573 See merge request: Ascend/MindSpeed-LLM!4693 | 1 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
fix(pytorch):add ckpt-format argument to scripts Co-authored-by: z__y<z4t155664@163.com> # message auto-generated for no-merge-commit merge: !4371 merge add_ckpt_torch_dist_argument_for_shells into master fix(pytorch):add ckpt-format argument to scripts Created-by: z__y Commit-by: z__y Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR explicitly adds ckpt-format torch to all repository scripts to support the asynchronous checkpoint saving feature. ## Does this PR introduce any user-facing change? No. This change only adjusts internal script parameters to maintain existing behavior. There are no user-facing API or usage changes. ## How was this patch tested? Tests confirm that asynchronous checkpoint saving works correctly and that the original torch format checkpoint behavior is preserved. See merge request: Ascend/MindSpeed-LLM!4371 | 4 个月前 | |
fix(pytorch):add ckpt-format argument to scripts Co-authored-by: z__y<z4t155664@163.com> # message auto-generated for no-merge-commit merge: !4371 merge add_ckpt_torch_dist_argument_for_shells into master fix(pytorch):add ckpt-format argument to scripts Created-by: z__y Commit-by: z__y Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR explicitly adds ckpt-format torch to all repository scripts to support the asynchronous checkpoint saving feature. ## Does this PR introduce any user-facing change? No. This change only adjusts internal script parameters to maintain existing behavior. There are no user-facing API or usage changes. ## How was this patch tested? Tests confirm that asynchronous checkpoint saving works correctly and that the original torch format checkpoint behavior is preserved. See merge request: Ascend/MindSpeed-LLM!4371 | 4 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 | |
fix: revert online weight conversion support for model scripts that do not support it. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4694 merge Train_from_HF into master fix: revert online weight conversion support for model scripts that do not support it. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Some training scripts currently use online weight conversion, but this feature is not yet supported for the corresponding models. Therefore, this PR reverts those scripts to use offline weight conversion instead. ## Does this PR introduce any user-facing change? The affected scripts switch from online weight conversion to offline weight conversion. ## How was this patch tested? By running the corresponding tests successfully. See merge request: Ascend/MindSpeed-LLM!4694 | 1 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 个月前 | ||
| 4 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 |