| feat: add skill - mindspeed-mm-fsdp2-model-only-migration Co-authored-by: hanyyy<hanyue42@huawei.com> # message auto-generated for no-merge-commit merge: !2595 merge model-migration into master feat: add skill - mindspeed-mm-fsdp2-model-only-migration Created-by: vasileone Commit-by: hanyyy Merged-by: ascend-robot Description: ## What this PR does / why we need it? 新增 mindspeed-mm-fsdp2-model-only-migration skill，用于指导仅模型开源、缺少训练 pipeline 的模型迁移到 MindSpeed-MM 插件式 FSDP2 后端。 同时移除旧的 VLM 专用 skill，补充 FSDP2 框架地图 reference 和迁移流程示意图，提升模型迁移流程的泛化性和可执行性。 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? 文档/skill 更新，不涉及运行测试。 See merge request: Ascend/MindSpeed-MM!2595 | 1 个月前 |
| docs: modify pull request template Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2225 merge master into master docs: modify pull request template Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? 按照最新的标准修改pr模板 ## Does this PR introduce any user-facing change? 不涉及代码功能 ## How was this patch tested? 不涉及 See merge request: Ascend/MindSpeed-MM!2225 | 4 个月前 |
| docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 1 天前 |
| bugfix：版本级代码检查 Co-authored-by: yaoyaoxu<xuyaoyao.824404@huawei.com> # message auto-generated for no-merge-commit merge: !2738 merge mm_fix_bugs_260629 into master bugfix：版本级代码检查 Created-by: yaoyaoxu Commit-by: yaoyaoxu Merged-by: ascend-robot Description: ## What this PR does / why we need it? CI检查代码问题和敏感词问题，根据python规则及建议进行修改 ## Does this PR introduce any user-facing change? 代码规范问题，不涉及用户界面修改 ## How was this patch tested? 通过已有ut和st See merge request: Ascend/MindSpeed-MM!2738 | 22 天前 |
| feat: Adapt for save_async feature Co-authored-by: LKONE<wanglikai4@huawei.com> # message auto-generated for no-merge-commit merge: !2825 merge MM-0712 into master feat: Adapt for save_async feature Created-by: wanglikai1019 Commit-by: LKONE Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. 校正dcp_to_hf函数的缩进语法问题，从八个空格改为四个空格； 2. 修改save_async配置说明，当前仅支持dcp权重异步保存，非dcp权重保存且同时开启了异步保存功能时，打印提示； 3. save_checkpointer.save方法调用时传入save_async参数。 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? 测试dcp权重异步保存功能是否正常。 See merge request: Ascend/MindSpeed-MM!2825 | 9 天前 |
| feat: add Dockerfile for CI env Co-authored-by: zhangxubin<zhangxubin3@h-partners.com> # message auto-generated for no-merge-commit merge: !2797 merge master into master feat: add Dockerfile for CI env Created-by: MoCuishle-M Commit-by: zhangxubin Merged-by: ascend-robot Description: ## What this PR does / why we need it? 本 PR 为 MindSpeed-MM 新增 CI 多版本镜像构建能力，并同步调整了镜像 Tag 命名规范、文档文字表达（torch_npu变更为TorchNPU）。 一、新增文件 1. ci/build_ci_envs.sh（新增） CI 镜像构建入口脚本，调用 docker/build.sh 并以 --build-ci 参数构建基于 CANN<版本> / torch_npu 2.7.1.<版本> / MindSpeed-MM <版本> 的 CI 镜像。 2. ci/mm_ci_trigger.sh（新增） PR 流水线云端测试触发脚本，负责：初始化 NPU/conda 环境、导出 PR 修改文件列表、按分支拉取 Megatron-LM（core_v0.12.1）与 MindSpeed、安装 MindSpeed-MM，并执行 access_control_test.py 进行 UT/ST 测试，结束后清理临时仓库。 3. docker/scripts/ci/build_ci_envs.py（新增） Python 脚本，读取 ci_versions.json，为每个 CI 版本从 base 环境克隆出独立 conda 环境（ci_<版本>），浅克隆对应分支代码，解析 pyproject.toml 安装基础依赖及 JSON 中指定的额外依赖（如指定版本 torch_npu）。 4. docker/scripts/ci/ci_versions.json（新增） CI 版本配置文件，定义 ci_26.0.0、ci_26.1.0、ci_master 三个环境及其各自 torch_npu等自定义依赖。 二、修改文件 5. docker/Dockerfile - 新增 BUILD_CI 构建参数，支持两种构建目标： - BUILD_CI=false（默认）：开发镜像，安装 verl_qwen3vl 并克隆 MindSpeed-MM 仓库。 - BUILD_CI=true：CI 镜像，跳过 verl 与仓库克隆，改为运行 build_ci_envs.py 创建多版本 conda 环境，并预下载 transformers（commit 7a833d1）和 Megatron-LM（core_v0.12.1）到 /workspace。 - 新增 FINAL_WORKDIR 参数，CI 模式工作目录为 /workspace，开发模式为 /workspace/MindSpeed-MM。 - 对原有各步骤补充了详细英文注释。 6. docker/build.sh - 新增 --build-ci 参数（构建 CI 多版本镜像）和 --tag 参数（自定义镜像 tag）。 - 新增基础镜像 CANN 版本自动识别逻辑（DETECTED_CANN_VERSION）。 - 镜像 Tag 命名规范变更： - 旧：{version}-{chip}-{os}-py{py_ver}-{arch} - 新：v{version}-cann{cann_ver}-torch_npu{torch_npu_ver}-{chip}-{os}-py{py_ver}-{arch}[-ci] - CI 构建时自动在 tag 末尾追加 -ci，并传入 BUILD_CI 与 FINAL_WORKDIR 构建参数。 7. docker/OVERVIEW.md / docker/OVERVIEW.zh.md（中英文文档同步更新） - 更新镜像 Tag 字段说明表，新增 CANN 版本、torch_npu 版本、其他字段（ci）等必选/可选字段说明及示例。 - 删除固定的「软件栈」版本表（因其随版本变化）。 - 文档中所有示例镜像名同步更新为新命名格式。 - torch_npu更改名字成TorchNPU 8. docker/scripts/ci/build_ci_envs.py - 华为云链接失效，换成清华的。 三、核心影响 - 镜像 Tag 命名 breaking change：所有镜像 tag 新增 cann 与 torch_npu 版本字段，旧 tag 不再适用。 - 新增 CI 镜像构建链路，使 PR 流水线可在云端复用预置多版本 conda 环境与预下载依赖，提升测试稳定性与效率。 ## Does this PR introduce any user-facing change? 当整个PR流水线整改完之后会在相应的文档中说明如何构建CI环境 ## How was this patch tested? / See merge request: Ascend/MindSpeed-MM!2797 | 8 天前 |
| feat: add Dockerfile for CI env Co-authored-by: zhangxubin<zhangxubin3@h-partners.com> # message auto-generated for no-merge-commit merge: !2797 merge master into master feat: add Dockerfile for CI env Created-by: MoCuishle-M Commit-by: zhangxubin Merged-by: ascend-robot Description: ## What this PR does / why we need it? 本 PR 为 MindSpeed-MM 新增 CI 多版本镜像构建能力，并同步调整了镜像 Tag 命名规范、文档文字表达（torch_npu变更为TorchNPU）。 一、新增文件 1. ci/build_ci_envs.sh（新增） CI 镜像构建入口脚本，调用 docker/build.sh 并以 --build-ci 参数构建基于 CANN<版本> / torch_npu 2.7.1.<版本> / MindSpeed-MM <版本> 的 CI 镜像。 2. ci/mm_ci_trigger.sh（新增） PR 流水线云端测试触发脚本，负责：初始化 NPU/conda 环境、导出 PR 修改文件列表、按分支拉取 Megatron-LM（core_v0.12.1）与 MindSpeed、安装 MindSpeed-MM，并执行 access_control_test.py 进行 UT/ST 测试，结束后清理临时仓库。 3. docker/scripts/ci/build_ci_envs.py（新增） Python 脚本，读取 ci_versions.json，为每个 CI 版本从 base 环境克隆出独立 conda 环境（ci_<版本>），浅克隆对应分支代码，解析 pyproject.toml 安装基础依赖及 JSON 中指定的额外依赖（如指定版本 torch_npu）。 4. docker/scripts/ci/ci_versions.json（新增） CI 版本配置文件，定义 ci_26.0.0、ci_26.1.0、ci_master 三个环境及其各自 torch_npu等自定义依赖。 二、修改文件 5. docker/Dockerfile - 新增 BUILD_CI 构建参数，支持两种构建目标： - BUILD_CI=false（默认）：开发镜像，安装 verl_qwen3vl 并克隆 MindSpeed-MM 仓库。 - BUILD_CI=true：CI 镜像，跳过 verl 与仓库克隆，改为运行 build_ci_envs.py 创建多版本 conda 环境，并预下载 transformers（commit 7a833d1）和 Megatron-LM（core_v0.12.1）到 /workspace。 - 新增 FINAL_WORKDIR 参数，CI 模式工作目录为 /workspace，开发模式为 /workspace/MindSpeed-MM。 - 对原有各步骤补充了详细英文注释。 6. docker/build.sh - 新增 --build-ci 参数（构建 CI 多版本镜像）和 --tag 参数（自定义镜像 tag）。 - 新增基础镜像 CANN 版本自动识别逻辑（DETECTED_CANN_VERSION）。 - 镜像 Tag 命名规范变更： - 旧：{version}-{chip}-{os}-py{py_ver}-{arch} - 新：v{version}-cann{cann_ver}-torch_npu{torch_npu_ver}-{chip}-{os}-py{py_ver}-{arch}[-ci] - CI 构建时自动在 tag 末尾追加 -ci，并传入 BUILD_CI 与 FINAL_WORKDIR 构建参数。 7. docker/OVERVIEW.md / docker/OVERVIEW.zh.md（中英文文档同步更新） - 更新镜像 Tag 字段说明表，新增 CANN 版本、torch_npu 版本、其他字段（ci）等必选/可选字段说明及示例。 - 删除固定的「软件栈」版本表（因其随版本变化）。 - 文档中所有示例镜像名同步更新为新命名格式。 - torch_npu更改名字成TorchNPU 8. docker/scripts/ci/build_ci_envs.py - 华为云链接失效，换成清华的。 三、核心影响 - 镜像 Tag 命名 breaking change：所有镜像 tag 新增 cann 与 torch_npu 版本字段，旧 tag 不再适用。 - 新增 CI 镜像构建链路，使 PR 流水线可在云端复用预置多版本 conda 环境与预下载依赖，提升测试稳定性与效率。 ## Does this PR introduce any user-facing change? 当整个PR流水线整改完之后会在相应的文档中说明如何构建CI环境 ## How was this patch tested? / See merge request: Ascend/MindSpeed-MM!2797 | 8 天前 |
| docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 1 天前 |
| docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 1 天前 |
| bugfix: adapt LoRA Megatron dispatcher to PEFT API Co-authored-by: ye_qm<yeqiangmao@huawei.com> # message auto-generated for no-merge-commit merge: !2862 merge codex/origin-master-20260720 into master bugfix: adapt LoRA Megatron dispatcher to PEFT API Created-by: ye_qm Commit-by: ye_qm Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR fixes a compatibility issue between MindSpeed-MM's LoRA patch and the latest PEFT dispatch_megatron API. PEFT now invokes the dispatcher with the keyword argument lora_config: python dispatcher(target, adapter_name, lora_config=lora_config, **kwargs) However, the existing wrapper expected an argument named config, causing LoRA model initialization to fail with: text TypeError: apply_patches.<locals>._patched_dispatch_megatron() missing 1 required positional argument: 'config' This PR updates the wrapper to: - Accept lora_config instead of config. - Read fan_in_fan_out from lora_config. - Forward the configuration using lora_config=lora_config. - Preserve the existing conditional patching behavior when dispatch_megatron is available. Related issue: N/A. ## Does this PR introduce any user-facing change? No user-facing API or configuration changes are introduced. After this fix, users can initialize and train LoRA models with compatible PEFT versions without encountering the dispatch_megatron argument mismatch. Existing training commands and configuration files remain unchanged. Documentation changes are not required. ## How was this patch tested? self test See merge request: Ascend/MindSpeed-MM!2862 | 17 小时前 |
| feat: add gitleaks secret detection Co-authored-by: zhangxubin<zhangxubin3@h-partners.com> # message auto-generated for no-merge-commit merge: !2817 merge master into master feat: add gitleaks secret detection Created-by: MoCuishle-M Commit-by: zhangxubin Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. 引入gitleaks二进制离线扫描工具 2. 新增pre-commit/.gitleaks.toml配置，继承官方全部检测规则 3. 配置pre-commit钩子，提交前自动扫描密钥硬编码风险。 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? PR流水线pre-commit检测新增敏感信息检测. See merge request: Ascend/MindSpeed-MM!2817 | 12 天前 |
| fix: ! operator causes CANN exit code to always be 0 in install.sh Co-authored-by: zhangzhiqiang90<zhangzhiqiang90@h-partners.com> # message auto-generated for no-merge-commit merge: !2731 merge fix/install-sh-exit-code into master fix: ! operator causes CANN exit code to always be 0 in install.sh Created-by: RyanChang2026 Commit-by: zhangzhiqiang90 Merged-by: ascend-robot Description: ## What this PR does / why we need it? In scripts/install.sh:223, the ! operator in Bash negates the exit code before $? captures it, so $? is always 0 when CANN installation fails. The real exit code is lost. Fix https://gitcode.com/Ascend/MindSpeed-MM/issues/469 ## Does this PR introduce any user-facing change? Move command execution before the if check so $? captures the actual exit code. ## How was this patch tested? 本地自验证 See merge request: Ascend/MindSpeed-MM!2731 | 21 天前 |
| docs: eplb docs Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2720 merge eplb_docs into master docs: eplb docs Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? EP负载均衡特性的文档说明 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? 文档不涉及 See merge request: Ascend/MindSpeed-MM!2720 | 27 天前 |
| feat: support fsdp2 preload the batch data during training Co-authored-by: WendongPang<pangwendong@huawei.com> # message auto-generated for no-merge-commit merge: !2810 merge preload into master feat: support fsdp2 preload the batch data during training Created-by: WendongPang Commit-by: WendongPang Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/322 https://gitcode.com/Ascend/MindSpeed-MM/issues/424 完善了数据预加载preloader： 1. 使用多线程和多流机制来实现get batch和move to device(h2d)的掩盖； 2. 新增trigger_h2d在每次反向结束后显示触发move to device，因为此时显存已经来到了一个较低的水平，h2d不会抬高device上的峰值显存； 3. 优化了数据报错的抛出，将get batch时的StopIteration和Exception分离单独处理，并在主线程抛出Exception的报错堆栈。 ## Does this PR introduce any user-facing change? 开启时需要将以下开关置为true： data dataloader_param: enable_preload: true ## How was this patch tested? 长跑性能不劣化，消除周期性时间波动，开启前后精度对齐。 See merge request: Ascend/MindSpeed-MM!2810 | 6 天前 |
| docs: fix master doc ci Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2651 merge doc-scan-fix into master docs: fix master doc ci Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? fix doc ci ## Does this PR introduce any user-facing change? fix doc ci ## How was this patch tested? fix doc ci See merge request: Ascend/MindSpeed-MM!2651 | 1 个月前 |
| 修改完善pre-commit工具配置 Co-authored-by: wujinyuan1<wujinyuan1@huawei.com> # message auto-generated for no-merge-commit merge: !2470 merge master into master 修改完善pre-commit工具配置 Created-by: wujinyuan1 Commit-by: wujinyuan1 Merged-by: ascend-robot Description: ## What this PR does / why we need it? pre-commit 工具规则配置修改：试运行阶段发现python bandit工具检测过严，超出昇腾编程规范。 此次修改重点修改bandit规则。 ## Does this PR introduce any user-facing change? 门禁codecheck检测规则精简，提升代码合入效率 ## How was this patch tested? 代码扫描工具配置，不涉及代码仓功能 See merge request: Ascend/MindSpeed-MM!2470 | 2 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| feat: add gitleaks secret detection Co-authored-by: zhangxubin<zhangxubin3@h-partners.com> # message auto-generated for no-merge-commit merge: !2817 merge master into master feat: add gitleaks secret detection Created-by: MoCuishle-M Commit-by: zhangxubin Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. 引入gitleaks二进制离线扫描工具 2. 新增pre-commit/.gitleaks.toml配置，继承官方全部检测规则 3. 配置pre-commit钩子，提交前自动扫描密钥硬编码风险。 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? PR流水线pre-commit检测新增敏感信息检测. See merge request: Ascend/MindSpeed-MM!2817 | 12 天前 |
| docs: 移除文档中 MindSpore 相关展示 Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2670 merge docs-fix into master docs: 移除文档中 MindSpore 相关展示 Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? 移除文档中 MindSpore 相关展示(目录树/Profiler项),仅保留 PyTorch 移除出海描述 ## Does this PR introduce any user-facing change? 移除文档中 MindSpore 相关展示(目录树/Profiler项),仅保留 PyTorch 移除出海描述 ## How was this patch tested? read See merge request: Ascend/MindSpeed-MM!2670 | 1 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| !325 【测试】添加InternVL2-8B ST & build打包内容完善 Merge pull request !325 from 陆劲夫/master | 1 年前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 1 天前 |
| docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 1 天前 |
| feat: Migrate MiniMax-M3-VL model from source repository Co-authored-by: vasileone<hanyue42@huawei.com> # message auto-generated for no-merge-commit merge: !2808 merge minimax_m3_push_new into master feat: Migrate MiniMax-M3-VL model from source repository Created-by: vasileone Commit-by: vasileone Merged-by: ascend-robot Description: ## What this PR does / why we need it? 将 MiniMax-M3-VL 多模态模型源仓实现从 HuggingFace transformers 源仓复制迁移到 MindSpeed-MM 中。 新增模型模块位于 mindspeed_mm/fsdp/models/minimax_m3_vl/ ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2808 | 7 天前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| bugfix: 合法合规风险数据修复 Co-authored-by: yaoyaoxu<xuyaoyao.824404@huawei.com> # message auto-generated for no-merge-commit merge: !2763 merge codecheck_260702 into master bugfix: 合法合规风险数据修复 Created-by: yaoyaoxu Commit-by: yaoyaoxu Merged-by: ascend-robot Description: ## What this PR does / why we need it? 合法合规风险数据修复：补充缺少的Copyright ## Does this PR introduce any user-facing change? 不涉及用户界面修改 ## How was this patch tested? 通过已有ut和st See merge request: Ascend/MindSpeed-MM!2763 | 19 天前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| [Bugfix] fix protobuf resource conflict bug Co-authored-by: LKONE<wanglikai4@huawei.com> # message auto-generated for no-merge-commit merge: !2343 merge master into master [Bugfix] fix protobuf resource conflict bug Created-by: wanglikai1019 Commit-by: LKONE Merged-by: ascend-robot Description: ## What this PR does / why we need it? 当环境中存在tensorflow时，直接拉起训练脚本，在import transformers时会因框架不兼容导致段错误，程序异常退出 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? 在装有tensorflow库的环境中拉起训练脚本，看是否能够正常运行 See merge request: Ascend/MindSpeed-MM!2343 | 3 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| [modify] modify the threshold for gc in qwen3_vl 30B Co-authored-by: ye_qm<yeqiangmao@huawei.com> # message auto-generated for no-merge-commit merge: !2593 merge fix-qwen3vl-gc into master [modify] modify the threshold for gc in qwen3_vl 30B Created-by: ye_qm Commit-by: ye_qm Merged-by: ascend-robot Description: ## What this PR does / why we need it? This PR adds an optional GC threshold setting for Qwen3-VL 30B LoRA fine-tuning. Background: During Qwen3-VL 30B training, Python GC behavior may introduce performance fluctuation in some runs. This PR allows the Qwen3-VL 30B LoRA training script to explicitly enable a tuned GC threshold before training starts. Changes: - Adds ENABLE_GC_THRESHOLD=1 to examples/qwen3vl/finetune_lora_qwen3vl_30B.sh. - Updates pretrain_transformers.py to read ENABLE_GC_THRESHOLD. - When ENABLE_GC_THRESHOLD is set to "1", pretrain_transformers.py applies gc.set_threshold(700, 10, 1000). - If the environment variable is not set, the default behavior is unchanged. ## Does this PR introduce any user-facing change? Yes, but it is limited to an optional environment variable. Users can enable the GC threshold behavior by setting: export ENABLE_GC_THRESHOLD=1 The Qwen3-VL 30B LoRA example script enables this variable by default. Other training scripts are not affected unless they also set ENABLE_GC_THRESHOLD=1. No public API is changed. Related script: examples/qwen3vl/finetune_lora_qwen3vl_30B.sh ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2593 | 1 个月前 |
| style: pre-commit autofix cleancode (base check) Co-authored-by: liyingxuan<liyingxuan3@huawei.com> # message auto-generated for no-merge-commit merge: !2616 merge master into master style: pre-commit autofix cleancode (base check) Created-by: liyx616 Commit-by: liyingxuan Merged-by: ascend-robot Description: ## What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2616 | 1 个月前 |
| feat: upgrade diffusers Co-authored-by: htwang<wanghaitao60@huawei.com> # message auto-generated for no-merge-commit merge: !2766 merge master into master feat: upgrade diffusers Created-by: htwang Commit-by: htwang Merged-by: ascend-robot Description: ## What this PR does / why we need it? 升级diffusers版本到0.38.0 ## Does this PR introduce any user-facing change? 1、升级diffusers依赖版本 2、删掉日落模型部分代码 ## How was this patch tested? ST、UT看护验证 See merge request: Ascend/MindSpeed-MM!2766 | 16 天前 |
