| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
chore(pytorch):optimize GLM5 pretraining script Co-authored-by: HanhuiChen<chenhanhui1@h-partners.com> # message auto-generated for no-merge-commit merge: !4340 merge glm into master chore(pytorch):optimize GLM5 pretraining script Created-by: HANHU1CHEN Commit-by: HanhuiChen Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR updates the GLM5 pretraining script to improve training performance and efficiency. ## Does this PR introduce any user-facing change? No major user-facing changes, but minor adjustments to configs or launch commands may be required. ## How was this patch tested? Validated through end-to-end pretraining runs, confirming improved performance and stable training behavior. See merge request: Ascend/MindSpeed-LLM!4340 | 5 个月前 | |
[pytorch][model]add megatron weight-converter for glm5 Co-authored-by: l00961550<liuqingyuan19@huawei.com> # message auto-generated for no-merge-commit merge: !4162 merge master into master [pytorch][model]add megatron weight-converter for glm5 Created-by: lqy16 Commit-by: l00961550 Merged-by: ascend-robot Description: add megatron weight-converter for glm5 See merge request: Ascend/MindSpeed-LLM!4162 | 6 个月前 | |
[pytorch][model]add pretrain_glm5_744b_4k_A3_ptd.sh Co-authored-by: EVA1<jingsiyu1@huawei.com> # message auto-generated for no-merge-commit merge: !4189 merge master into master [pytorch][model]add pretrain_glm5_744b_4k_A3_ptd.sh Created-by: EVA1 Commit-by: EVA1 Merged-by: ascend-robot Description: add pretrain_glm5_744b_4k_A3_ptd.sh See merge request: Ascend/MindSpeed-LLM!4189 | 6 个月前 | |
fix(pytorch):add ckpt-format argument to scripts Co-authored-by: z__y<z4t155664@163.com> # message auto-generated for no-merge-commit merge: !4371 merge add_ckpt_torch_dist_argument_for_shells into master fix(pytorch):add ckpt-format argument to scripts Created-by: z__y Commit-by: z__y Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR explicitly adds ckpt-format torch to all repository scripts to support the asynchronous checkpoint saving feature. ## Does this PR introduce any user-facing change? No. This change only adjusts internal script parameters to maintain existing behavior. There are no user-facing API or usage changes. ## How was this patch tested? Tests confirm that asynchronous checkpoint saving works correctly and that the original torch format checkpoint behavior is preserved. See merge request: Ascend/MindSpeed-LLM!4371 | 5 个月前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 24 天前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 5 个月前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 5 个月前 | ||
| 24 天前 |