| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
docs:modify Qwen3.5-35B Readme and related document Co-authored-by: songke029<songke29@huawei.com> # message auto-generated for no-merge-commit merge: !3037 merge master into master docs:modify Qwen3.5-35B Readme and related document Created-by: songke029 Commit-by: songke029 Merged-by: ascend-robot Description: ## What this PR does / why we need it? There are some usability issues with the current installation and fine-tuning guide for Qwen3.5, as well as its associated documentation and shell scripts. 当前Qwen3.5的安装和微调指南以及其相关文档和.sh文件存在一些易用性问题 ## Does this PR introduce any user-facing change? examples/qwen3_5/README.md docs/zh/features/building_data_for_VLModel.md ## How was this patch tested? Run bash scripts/install.sh --msbranch master to test if the change in install.sh that skips the .postX suffix in version checks works as expected. bash scripts/install.sh --msbranch master用于测试install.sh修改版本检查时忽略 .postX 后缀是否生效 See merge request: Ascend/MindSpeed-MM!3037 | 1 个月前 | |
modify: fix distributed inference data sharding Co-authored-by: LKONE<wanglikai4@huawei.com> # message auto-generated for no-merge-commit merge: !3079 merge MM-infer-data into master modify: fix distributed inference data sharding Created-by: wanglikai1019 Commit-by: LKONE Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. 调整推理/评测文档中gdn和causal_conv1d算子实现方式为ascendc； 2. 修复gdn和causal_conv1d算子实现方式为ascendc时推理结果乱码的bug； 3. 推理框架调用StatefulDataLoader实现数据分片机制，每个rank完成不同数据推理，最后由rank0调用gather完成数据统计和打印；增加数据无法被卡数整除时的padding机制； 4. 删除推理/评测文档中对ViT部分的分片，防止同一批数据中同时包含多模态/纯文本数据时，纯文本数据推理流程没有ViT前向导致同一通信组内不同rank参与collective的顺序不一致问题。 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? 按照修改后文档进行推理/评测，功能正常，不同rank能够并发处理不同数据。 See merge request: Ascend/MindSpeed-MM!3079 | 1 个月前 | |
docs: AIDD扫描问题处理 Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2849 merge 0715_AIDD into master docs: AIDD扫描问题处理 Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? AIDD扫描问题处理 ## Does this PR introduce any user-facing change? AIDD扫描问题处理 ## How was this patch tested? readthedoc See merge request: Ascend/MindSpeed-MM!2849 | 2 个月前 | |
docs:Update quickstart.md （update Wan2.1 to Wan2.2） Co-authored-by: songke029<songke29@huawei.com> # message auto-generated for no-merge-commit merge: !3074 merge quickstart_wan2.2 into master docs:Update quickstart.md （update Wan2.1 to Wan2.2） Created-by: songke029 Commit-by: songke029 Merged-by: ascend-robot Description: ## What this PR does / why we need it? Upgrade Wan guide from 2.1 to 2.2 to support Wan2.2-T2V-A14B structure and toolchain, fixing paths, arguments, and formatting. 将 Wan 使用指南从 2.1 升级至 2.2，适配 Wan2.2-T2V-A14B 的模型结构与工具链，并修正路径、参数及格式问题。 ## Does this PR introduce any user-facing change? Modified：MindSpeed-MM\docs\zh\pytorch\quickstart.md ## How was this patch tested? A3服务器验证相关文档已跑通 See merge request: Ascend/MindSpeed-MM!3074 | 1 个月前 | |
docs: 整改UserGuide/config中相关文档的说明 Co-authored-by: weixin_44031810<gaojie75@huawei.com> # message auto-generated for no-merge-commit merge: !3000 merge master into master docs: 整改UserGuide/config中相关文档的说明 Created-by: gaojie_ Commit-by: weixin_44031810 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 本 PR 属于纯文档变更，目标修正 UserGuide/config 相关文档的说明内容。变更统计显示共修改 7 个文件、新增 1035 行、删除 0 行； 主要改动 修正 UserGuide/config 文档说明: 本次改动聚焦于更正 UserGuide/config 相关文档中的表述，属于文档说明层面的修正。 纯新增型文档变更: 变更以新增内容为主（新增 1035 行、删除 0 行），未涉及代码逻辑、接口、数据结构或配置项的实际修改。 https://gitcode.com/Ascend/MindSpeed-MM/issues/565 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!3000 | 1 个月前 | |
docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 2 个月前 | |
docs: AIDD扫描问题处理 Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2849 merge 0715_AIDD into master docs: AIDD扫描问题处理 Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? AIDD扫描问题处理 ## Does this PR introduce any user-facing change? AIDD扫描问题处理 ## How was this patch tested? readthedoc See merge request: Ascend/MindSpeed-MM!2849 | 2 个月前 | |
docs: AIDD扫描问题处理 Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2849 merge 0715_AIDD into master docs: AIDD扫描问题处理 Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? AIDD扫描问题处理 ## Does this PR introduce any user-facing change? AIDD扫描问题处理 ## How was this patch tested? readthedoc See merge request: Ascend/MindSpeed-MM!2849 | 2 个月前 | |
docs: 移除文档中 MindSpore 相关展示 Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2670 merge docs-fix into master docs: 移除文档中 MindSpore 相关展示 Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? 移除文档中 MindSpore 相关展示(目录树/Profiler项),仅保留 PyTorch 移除出海描述 ## Does this PR introduce any user-facing change? 移除文档中 MindSpore 相关展示(目录树/Profiler项),仅保留 PyTorch 移除出海描述 ## How was this patch tested? read See merge request: Ascend/MindSpeed-MM!2670 | 4 个月前 | |
docs:rename Ascend Extension for PyTorch Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !2836 merge master into master docs:rename Ascend Extension for PyTorch Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: ## What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed-MM/issues/506 1、更新Ascend Extension for PyTorch名称为TorchNPU 2、补充快速入门环境最低配置 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2836 | 2 个月前 | |
modify: remove dependency on third-party libraries Co-authored-by: WendongPang<pangwendong@huawei.com> # message auto-generated for no-merge-commit merge: !2719 merge remove into master modify: remove dependency on third-party libraries Created-by: WendongPang Commit-by: WendongPang Merged-by: ascend-robot Description: ## What this PR does / why we need it? modify: remove dependency on third-party libraries https://gitcode.com/Ascend/MindSpeed-MM/issues/311 ## Does this PR introduce any user-facing change? 开放了pandas, accelerate, peft的版本依赖，其中peft完成了megatron后端lora功能的适配，兼容旧版本0.7.1和当前最新版本0.19.1，移除了timm及相关的模型 ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed-MM!2719 | 3 个月前 | |
feat: Bump PyTorch to 2.10.0 and Python to 3.12 Co-authored-by: zhangxubin<zhangxubin3@h-partners.com> # message auto-generated for no-merge-commit merge: !3020 merge master into master feat: Bump PyTorch to 2.10.0 and Python to 3.12 Created-by: MoCuishle-M Commit-by: zhangxubin Merged-by: ascend-robot Description: ## What this PR does / why we need it? 升级pytorch到2.10.0，python到3.12 mindspore相关readme没有更改 即将日落的verl相关模型readme没有更改 遗留： CI环境还未更新 到pytorch 2.10.0，所以当前pyproject.toml 采用灰度支持2.7.1的形式。 ## Does this PR introduce any user-facing change? 升级pytorch到2.10.0，python到3.12。 更新相关的readme ## How was this patch tested? 1. 本地切换CI环境验证通过 2. 手动验证关键模型qwen3.5、wan2.2 通过（详见PR https://gitcode.com/Ascend/MindSpeed-MM/pull/2976） 3. 部分模型测试用例（实际上为冒烟用例）更新到pytorch 2.10.0，测试通过 风险：没有验证到的场景与模型在pytorch 2.10.0、python 3.12可能存在问题 See merge request: Ascend/MindSpeed-MM!3020 | 1 个月前 | |
修改路径替换脚本默认路径, docker描述修改 Co-authored-by: liuxi_<liuxi75@huawei.com> # message auto-generated for no-merge-commit merge: !2736 merge 0630_npupath into master feat: 修改路径替换脚本默认路径修改, 修改docker描述 Created-by: liuxi_ Commit-by: liuxi_ Merged-by: ascend-robot Description: ## What this PR does / why we need it? 按新要求,修改默认路径.验证docker, 修改docker场景下使用描述 ## Does this PR introduce any user-facing change? 按新要求,修改默认路径.验证docker, 修改docker场景下使用描述 ## How was this patch tested? 测试该使用场景下, 模型正常训练 See merge request: Ascend/MindSpeed-MM!2736 | 3 个月前 | |
docs: tools.md support fsdp2 backend Co-authored-by: LKONE<wanglikai4@huawei.com> # message auto-generated for no-merge-commit merge: !3001 merge MM-docs-modify into master docs: tools.md support fsdp2 backend Created-by: wanglikai1019 Commit-by: LKONE Merged-by: ascend-robot Description: ## What this PR does / why we need it? 原有的tools.md文档说明只适用于megatron或megatron + fsdp2混合框架，新增对纯 fsdp2 后端工具使用方式的说明。 ## Does this PR introduce any user-facing change? 无 ## How was this patch tested? 按文档描述方式可实现对fsdp2后端的工具使用。 See merge request: Ascend/MindSpeed-MM!3001 | 1 个月前 | |
feat(fsdp): add autograd anomaly detection Co-authored-by: ye_qm<yeqiangmao@huawei.com> # message auto-generated for no-merge-commit merge: !2966 merge yqm/autograd-anomaly-detection into master feat(fsdp): add autograd anomaly detection Created-by: ye_qm Commit-by: ye_qm Merged-by: ascend-robot Description: `` markdown ## What this PR does / why we need it? PyTorch autograd errors, such as backward operator failures and NaN gradients, can be difficult to locate because the error may not identify the corresponding forward operation. This PR adds environment-variable-controlled autograd anomaly detection for the MindSpeed-MM FSDP2 training path. Detailed changes: - Register a new FSDP2 environment variable: - Name: MM_DETECT_ANOMALY - Type: bool - Default: false - Read the environment variable through the centralized FSDP2 environment-variable manager. - Configure PyTorch anomaly detection during trainer initialization: python detect_anomaly = envs.MM_DETECT_ANOMALY torch.autograd.set_detect_anomaly(detect_anomaly) - Enable anomaly detection before model execution so backward failures can include the corresponding forward traceback. - Print a warning when anomaly detection is enabled because it significantly reduces training performance. - Apply the setting through the common Trainer.initialize() path, covering both the standard FSDP2 trainer and the FunASR trainer. - Add tests for: - the default disabled state; - boolean environment-variable conversion; - propagation of the environment-variable value to PyTorch. - Add troubleshooting documentation describing how to enable the feature and its performance limitations. - Replace the direct LOCAL_RANK environment read in model_container_hub.py with envs.LOCAL_RANK, keeping FSDP2 business code consistent with centralized environment-variable management. This is a debugging feature rather than a bugfix, so there is no related issue. ## Does this PR introduce any user-facing change? Yes. Users can enable autograd anomaly detection through the following environment variable: bash export MM_DETECT_ANOMALY=true The environment variable supports the project-wide boolean formats: - True values: 1, true, yes, y, on - False values: 0, false, no, n, off Values are case-insensitive and may contain surrounding whitespace. If MM_DETECT_ANOMALY is unset, it defaults to false. Therefore, existing training scripts and default runtime behavior are unchanged. To disable it explicitly: bash export MM_DETECT_ANOMALY=false Related documentation: text docs/zh/troubleshooting.md ## How was this patch tested? The following checks were performed: - Environment-variable unit tests: bash pytest tests/ut_fsdp/test_envs.py -q Result: text 63 passed - Python syntax compilation for all modified Python files. - git diff --check to detect whitespace errors. - Ruff and Black checks for the modified test files. - GitCode remote Git Hooks checks passed. The following test files cover this feature: text tests/ut_fsdp/test_envs.py tests/ut_fsdp/train/test_autograd_anomaly.py The tests verify that: 1. MM_DETECT_ANOMALY defaults to false when it is not exported. 2. Supported true and false strings are converted to Python bool values. 3. Trainer.initialize() calls: python torch.autograd.set_detect_anomaly(False) when the environment variable is disabled. 4. Trainer.initialize() calls: python torch.autograd.set_detect_anomaly(True) when the environment variable is enabled. 5. FSDP2 business code does not introduce unapproved direct os.getenv() or os.environ.get() calls. The focused trainer test can be run with: bash pytest tests/ut_fsdp/train/test_autograd_anomaly.py -v Usage constraints and limitations: - This feature is intended only for debugging. - Enabling it significantly reduces training performance. - It should remain disabled during formal or performance-sensitive training. - It helps trace backward failures to their corresponding forward operations, but it does not guarantee detection of every numerical issue. - In distributed training, anomaly information is reported by the rank on which the failure occurs. - The local development environment did not contain PyTorch, so the PyTorch-dependent trainer test was added but could not be executed locally. It should be executed by the project CI environment. `` See merge request: Ascend/MindSpeed-MM!2966 | 2 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 个月前 | ||
| 1 个月前 | ||
| 2 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 2 个月前 | ||
| 2 个月前 | ||
| 2 个月前 | ||
| 4 个月前 | ||
| 2 个月前 | ||
| 3 个月前 | ||
| 1 个月前 | ||
| 3 个月前 | ||
| 1 个月前 | ||
| 2 个月前 |