| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
fix(pytorch): ckpt convert V2 bug fix Co-authored-by: cjy840282<chenjingyi9@huawei.com> # message auto-generated for no-merge-commit merge: !4463 merge ckpt_fix into master fix(pytorch): ckpt convert V2 bug fix Created-by: cjy840282 Commit-by: cjy840282 Merged-by: ascend-robot Description: ## What this PR does / why we need it? Ckpt convert V2 bug fix. Delete args: --spec/--use-mcore-models/--tokenizer-model/--params-dtype ## Does this PR introduce any user-facing change? Ckpt convert V2 runs without errors. ## How was this patch tested? Validated in the test environment. See merge request: Ascend/MindSpeed-LLM!4463 | 2 个月前 | |
refactor(pytorch): delete ckpt-v1 Co-authored-by: qyzqyz<quyueze@h-partners.com> # message auto-generated for no-merge-commit merge: !4831 merge master into master refactor(pytorch): delete ckpt-v1 Created-by: qyzqyz Commit-by: qyzqyz Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR removes the legacy Weight Conversion V1 implementation and completes the migration to Weight Conversion V2. The main changes include: * Remove the deprecated Weight Conversion V1 codebase. * Migrate the remaining scripts that still depended on V1 to Weight Conversion V2. * Update related README and documentation to reflect the new conversion workflow. * Clean up obsolete files and references associated with the V1 implementation. This change simplifies code maintenance and ensures that all weight conversion workflows are unified under the actively maintained V2 framework. --- ## Does this PR introduce any user-facing change? Yes. Weight Conversion V1 is no longer supported. Users should use Weight Conversion V2 for all checkpoint conversion workflows. The related README and documentation have been updated accordingly to guide users to the new conversion process. --- ## How was this patch tested? The following verification was performed: * Verified that all remaining weight conversion scripts have been successfully migrated to Weight Conversion V2. * Verified that the updated conversion workflow functions correctly after removing the V1 implementation. * Verified that related documentation and examples are consistent with the current implementation. * Regression tests and pipeline ST passed successfully. See merge request: Ascend/MindSpeed-LLM!4831 | 10 天前 | |
[pytorch][bugfix] magistral sh update and hf2mg bugfix Co-authored-by: EVA1<jingsiyu1@huawei.com> # message auto-generated for no-merge-commit merge: !3650 merge magistral into master [pytorch][bugfix] magistral sh update and hf2mg bugfix Created-by: EVA1 Commit-by: EVA1 Merged-by: ascend-robot Description: 1.magistral微调脚本参数更新 2.权重转换脚本修复 See merge request: Ascend/MindSpeed-LLM!3650 | 8 个月前 | |
[pytorch][feature]magistral-small pretrain/sft Co-authored-by: EVA<jingsiyu1@huawei.com> # message auto-generated for no-merge-commit merge: !3468 merge pr_3392 into master [pytorch][feature]magistral-small pretrain/sft Created-by: EVA1 Commit-by: EVA1;EVA Merged-by: ascend-robot Description: 1.magistral-small type tokenizer 支持； 2.magistral-small-2506 模型支持：数据集格式转换、权重转换、微调、预训练； 3.精度已对齐，sft相对误差小于千分之一。 See merge request: Ascend/MindSpeed-LLM!3468 | 9 个月前 | |
fix(pytorch):add ckpt-format argument to scripts Co-authored-by: z__y<z4t155664@163.com> # message auto-generated for no-merge-commit merge: !4371 merge add_ckpt_torch_dist_argument_for_shells into master fix(pytorch):add ckpt-format argument to scripts Created-by: z__y Commit-by: z__y Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR explicitly adds ckpt-format torch to all repository scripts to support the asynchronous checkpoint saving feature. ## Does this PR introduce any user-facing change? No. This change only adjusts internal script parameters to maintain existing behavior. There are no user-facing API or usage changes. ## How was this patch tested? Tests confirm that asynchronous checkpoint saving works correctly and that the original torch format checkpoint behavior is preserved. See merge request: Ascend/MindSpeed-LLM!4371 | 4 个月前 | |
fix: enable train_from_hf for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4642 merge Train_from_HF into master fix: enable train_from_hf for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? MindSpeed-LLM now supports online loading of datasets and model weights during training, but the legacy scripts in /examples/mcore have not yet been enabled to use this new feature. This PR enables these pretraining and fine-tuning scripts to use online data and weight loading. reference: [https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md](https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md) ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4642 | 1 个月前 | |
fix: enable train_from_hf for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4642 merge Train_from_HF into master fix: enable train_from_hf for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? MindSpeed-LLM now supports online loading of datasets and model weights during training, but the legacy scripts in /examples/mcore have not yet been enabled to use this new feature. This PR enables these pretraining and fine-tuning scripts to use online data and weight loading. reference: [https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md](https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md) ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4642 | 1 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 2 个月前 | ||
| 10 天前 | ||
| 8 个月前 | ||
| 9 个月前 | ||
| 4 个月前 | ||
| 1 个月前 | ||
| 1 个月前 |