| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
optim: optimize the deepseekv3 poc script Co-authored-by: yanzhixiao23<yanzhixiao@h-partners.com> # message auto-generated for no-merge-commit merge: !4905 merge optim-v3 into master optim: optimize the deepseekv3 poc script Created-by: yanzhixiao23 Commit-by: yanzhixiao23 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1.Added the disable-fb-overlap-linear-dw-detach feature to fix the memory degradation caused by the fb-overlap feature's linear weight gradient analysis in Megatron version 0.12.1. 2.Refined the recomputation granularity to optimize overall network performance. ## Does this PR introduce any user-facing change? NA，only script optimizations ## How was this patch tested? Validated in a 512P environment. See merge request: Ascend/MindSpeed-LLM!4905 | 12 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
chore(megatron) DeepSeek V4 A3 long scripts Co-authored-by: guihaowen666<guihaowen@huawei.com> # message auto-generated for no-merge-commit merge: !5015 merge br_master_v4flash_long_A3_scripts into master chore(megatron) DeepSeek V4 A3 long scripts Created-by: guihaowen666 Commit-by: guihaowen666 Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR is used to add DeepSeekV4 A3 long sequence (64K, 156K) scripts ## Does this PR introduce any user-facing change? Only scripts are added, and service code is not modified. There is no user-facing change ## How was this patch tested? Local self-validation and CI gate access verification passed. See merge request: Ascend/MindSpeed-LLM!5015 | 2 天前 | |
test(feature): Replace Windows CRLF with Linux LF in the deepseekV4Flash 8P script Co-authored-by: guihaowen666<guihaowen@huawei.com> # message auto-generated for no-merge-commit merge: !4954 merge br_master_dsv4_8p_scripts_fix into master test(feature): Replace Windows CRLF with Linux LF in the deepseekV4Flash 8P script Created-by: guihaowen666 Commit-by: guihaowen666 Merged-by: ascend-robot Description: ## What this PR does / why we need it? The line feed character in the pretrain_deepseek4_flash_13.3b_4k_bf16_A5_ptd.sh script is of the CRLF type. When the script is executed in the Linux system, an error is reported. Therefore, you need to replace the line feed character in the script with the LF type. ## Does this PR introduce any user-facing change? Replace the CRLF line breaks in the script with LF line breaks. Thus there is no user-facing change. ## How was this patch tested? Passed local self-verification and CI verification. See merge request: Ascend/MindSpeed-LLM!4954 | 16 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat(mcore): add GLM-5.2 A5 POC scripts Co-authored-by: LinShua<707894133@qq.com> # message auto-generated for no-merge-commit merge: !5013 merge master_glm52_A5_sh into master feat(mcore): add GLM-5.2 A5 POC scripts Created-by: LinShua Commit-by: LinShua Merged-by: ascend-robot Description: Fixes #1825 ## What this PR does / why we need it? 1. Replaces the existing GLM-5.2 32B A5 POC entry with a 51B 4K FP8 configuration using TP1/PP2/EP4 parallelism, Transformer Engine MXFP8, index-topk=1024, fixed routing, the pipeline layout, and a matching log name. 2. Adds a GLM-5.2 210B 4K A5 FP8 POC entry with an eight-node TP1/PP2/EP32 configuration, Transformer Engine MXFP8 options, and portable data/tokenizer/checkpoint path placeholders. 3. Aligns --lr-warmup-iters to 500 in the GLM-5.2 744B A3 example, 744B A3 POC, and 210B A3 POC scripts. 4. This change is limited to five shell launch configurations and does not modify training runtime code or public APIs. ## Does this PR introduce any user-facing change? Yes. Users can run the new tests/poc/glm52/pretrain_glm52_210b_4k_A5_fp8_ptd.sh entry and the renamed tests/poc/glm52/pretrain_glm52_51b_4k_A5_ptd.sh entry. The 51B entry now uses the A5 MXFP8 and TP1/PP2/EP4 configuration, and the related A3 scripts now default to 500 learning-rate warmup iterations. ## How was this patch tested? 1. bash -n passed for all five changed shell scripts. 2. Changed-file pre-commit passed trailing-whitespace, end-of-file, added-large-file, merge-conflict, private-key, codespell, and typos checks. YAML, JSON, Python, and C/C++ hooks had no matching files. The repository-local gitleaks-offline-scan hook could not run because the required ./gitleaks executable is not present in the repository or local environment. 3. git diff --cached --check passed before amend. 4. The remote Git hook passed during git push --force-with-lease. 5. Functional, accuracy, performance, and end-to-end NPU training tests were not run. See merge request: Ascend/MindSpeed-LLM!5013 | 3 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat(pytorch): add hy3 Co-authored-by: qyzqyz<quyueze@h-partners.com> # message auto-generated for no-merge-commit merge: !4781 merge master into master feat(pytorch): add hy3 Created-by: qyzqyz Commit-by: qyzqyz Merged-by: ascend-robot Description: ## What this PR does / why we need it? - Add Hunyuan3 model adaptation. - Add Hunyuan3 model configuration. - Add Hunyuan3 weight conversion support. - Integrate Hunyuan3 into the existing model loading and training workflow. ## Does this PR introduce any user-facing change? Yes. This PR introduces support for the Hunyuan3 model. Users can now use MindSpeed-LLM to perform weight conversion and training for Hunyuan3 following the existing workflow. No user-facing changes are introduced for existing supported models. ## How was this patch tested? The following tests have been completed: - Pipeline ST passed. - Verified that Hunyuan3 weight conversion completes successfully. - Verified that the converted checkpoint can be loaded successfully. - Verified that the training workflow starts successfully after conversion. See merge request: Ascend/MindSpeed-LLM!4781 | 1 个月前 | |
fix: fix parameter name typo Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4953 merge Train_from_HF into master fix: fix train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Fixes a parameter name typo by changing --tokenizer-type PretrainedFormHF to --tokenizer-type PretrainedFromHF. Kimi2 does not currently support online weight conversion, removes the default enablement of online weight conversion in the script. ## Does this PR introduce any user-facing change? No. ## How was this patch tested? Verified through CI testing. See merge request: Ascend/MindSpeed-LLM!4953 | 20 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
fix: fix parameter name typo Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4953 merge Train_from_HF into master fix: fix train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Fixes a parameter name typo by changing --tokenizer-type PretrainedFormHF to --tokenizer-type PretrainedFromHF. Kimi2 does not currently support online weight conversion, removes the default enablement of online weight conversion in the script. ## Does this PR introduce any user-facing change? No. ## How was this patch tested? Verified through CI testing. See merge request: Ascend/MindSpeed-LLM!4953 | 20 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat: extend train_from_hf support for legacy scripts Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !4880 merge Train_from_HF into master feat: extend train_from_hf support for legacy scripts Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Enabled automatic data preprocessing for all training scripts under examples and tests/poc. Enabled automatic weight conversion for training scripts of all models below 300B parameters under examples and tests/poc (excluding DeepSeek3, DeepSeek4, and LongCat). ## Does this PR introduce any user-facing change? The updated scripts integrate data preprocessing, weight conversion, and training into a single workflow, allowing users to launch training jobs with a single script. The default --tokenizer-type in the Llama2 training script has been changed from Llama2Tokenizer to PretrainedFormHF, and --tokenizer-model ${TOKENIZER_MODEL} has been changed to --tokenizer-name-or-path ${TOKENIZER_MODEL}. TOKENIZER_MODEL only needs to be configured to the directory containing the target model's tokenizer. ## How was this patch tested? This PR was validated through smoke testing. See merge request: Ascend/MindSpeed-LLM!4880 | 22 天前 | |
feat(pytorch): add model minimax27 Co-authored-by: qyzqyz<quyueze@h-partners.com> # message auto-generated for no-merge-commit merge: !4735 merge master into master feat(pytorch): add model minimax27 Created-by: qyzqyz Commit-by: qyzqyz Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR adds support for the MiniMax-M27 model in MindSpeed-LLM, enabling users to perform model conversion and training with the MiniMax-M27 architecture. - Add MiniMax-M27 model adaptation. - Add the corresponding model configuration and weight conversion support. - Enable the MiniMax-M27 workflow in the existing training/conversion pipeline. ## Does this PR introduce any user-facing change? Yes. This PR introduces support for the MiniMax-M27 model. Users can now use MindSpeed-LLM to perform weight conversion and training for MiniMax-M27 following the existing workflow. No changes are required for existing models. ## How was this patch tested? The following tests have been completed: - Pipeline ST passed. - Verified that MiniMax-M27 weight conversion completes successfully. - Verified that the converted model can be loaded correctly. - Verified that the training workflow starts successfully after conversion. See merge request: Ascend/MindSpeed-LLM!4735 | 1 个月前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 | |
feat: Disable the train-from-hf feature under the poc directory. Co-authored-by: daixzh<daixuezheng@huawei.com> # message auto-generated for no-merge-commit merge: !5012 merge reset_poc into master feat: Disable the train-from-hf feature under the poc directory. Created-by: daixzh Commit-by: daixzh Merged-by: ascend-robot Description: ## What this PR does / why we need it? Disable train-from-hf in scripts under tests/poc and remove the corresponding parameter. Add the --ckpt-format torch parameter for Qwen models. ## Does this PR introduce any user-facing change? Yes. Scripts under tests/poc no longer support train-from-hf; the corresponding option has been removed. ## How was this patch tested? By passing the ci-pipeline. See merge request: Ascend/MindSpeed-LLM!5012 | 3 天前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 12 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 2 天前 | ||
| 16 天前 | ||
| 22 天前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 22 天前 | ||
| 1 个月前 | ||
| 20 天前 | ||
| 3 天前 | ||
| 20 天前 | ||
| 3 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 22 天前 | ||
| 1 个月前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 3 天前 | ||
| 3 天前 |