| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[pytorch][feature]adapt deepseek2-lite to convert ckpt v2 Co-authored-by: tichang<tichang@huawei.com> # message auto-generated for no-merge-commit merge: !3630 merge feat/ckpt-v2-deepseek2-lite into master [pytorch][feature]adapt deepseek2-lite to convert ckpt v2 Created-by: tichang Commit-by: tichang Merged-by: ascend-robot Description: adapt deepseek2-lite to convert ckpt v2 See merge request: Ascend/MindSpeed-LLM!3630 | 9 个月前 | |
[pytroch][feature]add enable mg2hf convert in train Co-authored-by: qyzqyz<quyueze@h-partners.com> # message auto-generated for no-merge-commit merge: !4096 merge master into master [pytroch][feature]add enable mg2hf convert in train Created-by: qyzqyz Commit-by: qyzqyz Merged-by: ascend-robot Description: add enable mg2hf See merge request: Ascend/MindSpeed-LLM!4096 | 6 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
fix(pytorch):add ckpt-format argument to scripts Co-authored-by: z__y<z4t155664@163.com> # message auto-generated for no-merge-commit merge: !4371 merge add_ckpt_torch_dist_argument_for_shells into master fix(pytorch):add ckpt-format argument to scripts Created-by: z__y Commit-by: z__y Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR explicitly adds ckpt-format torch to all repository scripts to support the asynchronous checkpoint saving feature. ## Does this PR introduce any user-facing change? No. This change only adjusts internal script parameters to maintain existing behavior. There are no user-facing API or usage changes. ## How was this patch tested? Tests confirm that asynchronous checkpoint saving works correctly and that the original torch format checkpoint behavior is preserved. See merge request: Ascend/MindSpeed-LLM!4371 | 4 个月前 | |
fix(pytorch):add ckpt-format argument to scripts Co-authored-by: z__y<z4t155664@163.com> # message auto-generated for no-merge-commit merge: !4371 merge add_ckpt_torch_dist_argument_for_shells into master fix(pytorch):add ckpt-format argument to scripts Created-by: z__y Commit-by: z__y Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR explicitly adds ckpt-format torch to all repository scripts to support the asynchronous checkpoint saving feature. ## Does this PR introduce any user-facing change? No. This change only adjusts internal script parameters to maintain existing behavior. There are no user-facing API or usage changes. ## How was this patch tested? Tests confirm that asynchronous checkpoint saving works correctly and that the original torch format checkpoint behavior is preserved. See merge request: Ascend/MindSpeed-LLM!4371 | 4 个月前 | |
fix: enable train_from_hf for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4642 merge Train_from_HF into master fix: enable train_from_hf for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? MindSpeed-LLM now supports online loading of datasets and model weights during training, but the legacy scripts in /examples/mcore have not yet been enabled to use this new feature. This PR enables these pretraining and fine-tuning scripts to use online data and weight loading. reference: [https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md](https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md) ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4642 | 1 个月前 | |
fix: enable train_from_hf for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4642 merge Train_from_HF into master fix: enable train_from_hf for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? MindSpeed-LLM now supports online loading of datasets and model weights during training, but the legacy scripts in /examples/mcore have not yet been enabled to use this new feature. This PR enables these pretraining and fine-tuning scripts to use online data and weight loading. reference: [https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md](https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md) ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4642 | 1 个月前 | |
fix: enable train_from_hf for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4642 merge Train_from_HF into master fix: enable train_from_hf for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? MindSpeed-LLM now supports online loading of datasets and model weights during training, but the legacy scripts in /examples/mcore have not yet been enabled to use this new feature. This PR enables these pretraining and fine-tuning scripts to use online data and weight loading. reference: [https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md](https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md) ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4642 | 1 个月前 | |
fix: enable train_from_hf for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4642 merge Train_from_HF into master fix: enable train_from_hf for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? MindSpeed-LLM now supports online loading of datasets and model weights during training, but the legacy scripts in /examples/mcore have not yet been enabled to use this new feature. This PR enables these pretraining and fine-tuning scripts to use online data and weight loading. reference: [https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md](https://gitcode.com/Ascend/MindSpeed-LLM/blob/master/docs/zh/pytorch/training/pretrain/mcore/train_from_hf.md) ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4642 | 1 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 9 个月前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 个月前 | ||
| 4 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 |