master

ascend-robotfeat: add disable linear dw

382c30b2创建于 7月24日历史提交

文件	最后提交记录	最后更新时间
megatron_moe	feat: add disable linear dw Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3712 merge disable-fb-linear-dw-detach into master feat: add disable linear dw Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 1. 取消linear默认dw分离操作，减少显存占用 2. 增加dense 输出重计算功能 3. 增加dense输出swap功能 4. 修复moe-zero-memory level1场景下fc1 输出未被swap in的bug ## Does this PR introduce any user-facing change? 不涉及 ## How was this patch tested? 不涉及 See merge request: Ascend/MindSpeed!3712	2 个月前
mxfp8	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
Automatic_Parallelism.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
LayerZeRO.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
activation-function-recompute.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
aiqos.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
alibi.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
async-ddp-param-gather.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
async-ddp.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
async-log-allreduce.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
auto_settings.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
automated-pipeline.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
balanced_moe.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
communication-over-computation.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
compress-tensor.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
context_parallelism_kv_cache.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
conv3d_sequence_paralle.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
custom_fsdp.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
data-parallel.md	docs: modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> Co-authored-by: fanlu5<fanlu5@huawei.com> Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3554 merge master into master docs: modify document Created-by: gh_55 Commit-by: z60112595;fanlu5;w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 根据AIDD和发烧友活动提出的问题修改了相关文档 https://gitcode.com/Ascend/MindSpeed/issues/146 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3554	3 个月前
dist_ckpt.md	docs: modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> Co-authored-by: fanlu5<fanlu5@huawei.com> Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3554 merge master into master docs: modify document Created-by: gh_55 Commit-by: z60112595;fanlu5;w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 根据AIDD和发烧友活动提出的问题修改了相关文档 https://gitcode.com/Ascend/MindSpeed/issues/146 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3554	3 个月前
distributed-optimizer.md	docs: modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> Co-authored-by: fanlu5<fanlu5@huawei.com> Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3554 merge master into master docs: modify document Created-by: gh_55 Commit-by: z60112595;fanlu5;w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 根据AIDD和发烧友活动提出的问题修改了相关文档 https://gitcode.com/Ascend/MindSpeed/issues/146 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3554	3 个月前
double-ring.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
dualpipev.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
eod-reset.md	docs: modify document Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3684 merge master into master docs: modify document Created-by: gh_55 Commit-by: w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 特性文档优化 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3684	2 个月前
feature_list.md	docs: modify document Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3684 merge master into master docs: modify document Created-by: gh_55 Commit-by: w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 特性文档优化 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3684	2 个月前
flash-attention.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
fsdp2.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
fused_ema_adamw_optimizer.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
fusion-attn-v2.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
generate-mask.md	docs: modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> Co-authored-by: fanlu5<fanlu5@huawei.com> Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3554 merge master into master docs: modify document Created-by: gh_55 Commit-by: z60112595;fanlu5;w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 根据AIDD和发烧友活动提出的问题修改了相关文档 https://gitcode.com/Ascend/MindSpeed/issues/146 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3554	3 个月前
hccl-group-buffer-set.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
hccl-replace-gloo.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
hybrid-context-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
kvallgather-context-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
low-precision-optimizer.md	docs: fix terminology and parameter descriptions across feature docs Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3596 merge master into master docs: fix terminology and parameter descriptions across feature docs Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix terminology and parameter descriptions across feature docs ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA See merge request: Ascend/MindSpeed!3596	3 个月前
mc2.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
moe-token-permute-and-unpermute.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
moe_expert_load_balance_placeemnt.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
multi-head-latent-attention.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
multi_parameter_pipeline.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
multi_parameter_pipeline_and_variable_seq_lengths.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
muon-optimizer.md	feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!3442	4 个月前
noop-layers.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
norm-recompute.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
npu_datadump.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
npu_deterministic.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
npu_matmul_add.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
ops_flops_cal.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
pipeline-model-parallel-layout.md	feat: add custom pp layout Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3496 merge add_pp_layout into master feat: add custom pp layout Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 新增pipeline-model-parallel-layout功能，支持自定义PP每个stage的层排布 验证链接：https://wiki.huawei.com/domains/137239/wiki/268925/WIKI2026052611233549 issue: https://gitcode.com/Ascend/MindSpeed/issues/166 See merge request: Ascend/MindSpeed!3496	3 个月前
pipeline-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
preprocess-eod-data.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
qad.md	feat(qad): implement QAD (Quantization-Aware Distillation) Co-authored-by: n_nddddd<lanshangwei1@huawei.com> # message auto-generated for no-merge-commit merge: !3638 merge feat_qad_1 into master feat(qad): implement QAD (Quantization-Aware Distillation) Created-by: n_nddddd Commit-by: n_nddddd Merged-by: ascend-robot Description: --- title: "feat(backend): implement QAD (Quantization-Aware Distillation)" labels: ["feat", "backend"] assignees: 'n_nddddd' --- ## What this PR does / why we need it? 大模型量化到 4-bit（MXFP4）后精度显著退化，传统 QAT 用交叉熵训练会改变输出分布，影响 RL 模型。 本 PR 实现 QAD（量化感知蒸馏）：用 BF16 全精度教师模型通过 KL 散度引导 MXFP4 W4A4 学生模型训练，忠实保留原始分布：L = α·KL。 核心组件： QADConfig — 配置数据类与校验 TeacherModelManager — 教师模型懒加载、检查点加载、参数冻结、单例管理 LogitsKLLoss — KL 损失，支持温度缩放和 TP 感知 softmax QADQuantEngineFeature — CLI 参数注册与快速失败校验 QADForwardStepPatch — 包装 pretrain() 注入 QAD 逻辑，KL 损失 支持模式：纯 KL。 ## Does this PR introduce any user-facing change? 是。新增 5个 CLI 参数（qad 参数组）： 参数 默认值 说明 --qad-enable False 启用 QAD --qad-teacher-load "" 教师检查点路径（启用时必填） --kl-temperature 1.0 KL 温度参数 --kl-loss-weight 1.0 KL 损失权重 α --kl-loss-reduction "mean" KL 归约方式（mean/sum） 文档：docs/zh/features/qad.md 约束：需相同架构的 BF16 教师检查点；纯 KL 模式要求 pretrain 入口可导入 get_batch。 ## How was this patch tested? 设计文档： https://wiki.huawei.com/domains/159368/wiki/325164/WIKI2026070911785637 实验数据： https://wiki.huawei.com/domains/159368/wiki/325164/WIKI2026062311569830?title=5--Core-Components 55 个单元测试全部通过： python -m pytest tests_extend/unit_tests/features/qad/ tests_extend/unit_tests/mindspeed/qad/ -v tached PASSED [100%] ============================== slowest durations ============================== (165 durations < 1s hidden.) ============================= 55 passed in 9.54s ============================== ruff check...............................................................Passed ruff format..............................................................Passed 覆盖：QADConfig 校验、LogitsKLLoss 输出/温度/归约/梯度、TeacherModelManager 生命周期、参数校验、QADForwardStepPatch 损失合并、TP 感知 softmax（TP=1 等价性 + TP=2 all-reduce 路径）。 代码质量：ruff check / ruff format / pylint 全部通过，0 warnings，0 # noqa 和 # pylint: disable 注释。 See merge request: Ascend/MindSpeed!3638	2 个月前
qat_quant.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
recomputation.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
recompute_independent_pipelining.md	docs: modify document Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3684 merge master into master docs: modify document Created-by: gh_55 Commit-by: w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 特性文档优化 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3684	2 个月前
reset-bucket-group-order.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
reuse-fp32-param.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
ring-attention-context-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
rms_norm.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
rotary-embedding.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
sequence-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
shared-experts.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
smart_swap.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
swap-optimizer.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
swap_attention.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
swiglu.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
te-comparison-online.md	docs: update multiple documentation contents Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3588 merge master into master docs: update multiple documentation contents Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: update multiple documentation contents 1. 补充FSDP2文档中重计算机制的详细说明与使用边界 2. 修正安装指南中的文档提示类型、Python版本说明和命令格式 3. 修复路径替换指南中的列表格式排版问题 ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA See merge request: Ascend/MindSpeed!3588	3 个月前
tensor-parallel-2d.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
tensor-parallel.md	docs: modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> Co-authored-by: fanlu5<fanlu5@huawei.com> Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3554 merge master into master docs: modify document Created-by: gh_55 Commit-by: z60112595;fanlu5;w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 根据AIDD和发烧友活动提出的问题修改了相关文档 https://gitcode.com/Ascend/MindSpeed/issues/146 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3554	3 个月前
transformer_engine.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
ulysses-context-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
unaligned-pipeline.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
unaligned-ring-context-parallel.md	docs: modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> Co-authored-by: fanlu5<fanlu5@huawei.com> Co-authored-by: w60124201<weiguohui4@h-partners.com> # message auto-generated for no-merge-commit merge: !3554 merge master into master docs: modify document Created-by: gh_55 Commit-by: z60112595;fanlu5;w60124201 Merged-by: ascend-robot Description: ## What this PR does / why we need it? 根据AIDD和发烧友活动提出的问题修改了相关文档 https://gitcode.com/Ascend/MindSpeed/issues/146 ## Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. ## How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!3554	3 个月前
unaligned-ulysses-context-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
unaligned_linear.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
variable_seq_lengths.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
verl-ckpt-acceleration.md	[docs] update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3472 merge master into master [docs] update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: What this PR does / why we need it? update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory - Update README.md and installation guide with latest changes - Update ops documentation and release notes - move png figures into 'figures' directory Does this PR introduce any user-facing change? NA How was this patch tested? NA See merge request: Ascend/MindSpeed!3472	4 个月前
virtual-optimizer.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前
virtual-pipeline-parallel.md	docs: fix Chinese documentation issues from AIDD review Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3704 merge master into master docs: fix Chinese documentation issues from AIDD review Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: ## What this PR does / why we need it? docs: fix Chinese documentation issues from AIDD review 本次修改根据AIDD文档评审反馈，修复了中文文档中的多处问题，包括： - 术语表述不准确（如"高保序性"、"低保真数据"等） - 公式错误（如分布式归一化中的方差计算公式） - 参数依赖关系描述不清（如 ulysses-degree-in-cp 的整除关系） - 特性描述与代码实现不一致（如 swap-optimizer 的 D2H/H2D 时序） - 性能提升概念混淆（如训练吞吐与收敛速度的区别） ## Does this PR introduce any user-facing change? NA ## How was this patch tested? NA  See merge request: Ascend/MindSpeed!3704	2 个月前